2021-03-31 12:25:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 12:25:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:25:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:25:13 [DEBUG   ] Finished updating board flags in 2.009 seconds
2021-03-31 12:25:29 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2021-03-31 12:25:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 12:26:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 12:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:26:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:26:13 [DEBUG   ] Finished updating board flags in 1.984 seconds
2021-03-31 12:26:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 12:26:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 12:27:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 12:27:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:27:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:27:13 [DEBUG   ] Finished updating board flags in 1.816 seconds
2021-03-31 12:27:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2021-03-31 12:27:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 12:28:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 12:28:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:28:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:28:13 [DEBUG   ] Finished updating board flags in 1.785 seconds
2021-03-31 12:28:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 12:28:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 12:29:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 12:29:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:29:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:29:13 [DEBUG   ] Finished updating board flags in 1.620 seconds
2021-03-31 12:29:20 [DEBUG   ] Got command RPT from MCS: ref #4202
2021-03-31 12:29:20 [DEBUG   ] summary = ERROR
2021-03-31 12:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4202  13 59304 44960213 A  ERRORERROR'
2021-03-31 12:29:20 [DEBUG   ] Got command RPT from MCS: ref #4203
2021-03-31 12:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4203  77 59304 44960213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:29:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 12:29:37 [DEBUG   ] Got command RPT from MCS: ref #4221
2021-03-31 12:29:37 [DEBUG   ] summary = ERROR
2021-03-31 12:29:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4221  13 59304 44977725 A  ERRORERROR'
2021-03-31 12:29:37 [DEBUG   ] Got command RPT from MCS: ref #4222
2021-03-31 12:29:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:29:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4222  77 59304 44977929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:29:38 [DEBUG   ] Got command RPT from MCS: ref #4223
2021-03-31 12:29:38 [DEBUG   ] summary = ERROR
2021-03-31 12:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4223  13 59304 44978133 A  ERRORERROR'
2021-03-31 12:29:38 [DEBUG   ] Got command RPT from MCS: ref #4224
2021-03-31 12:29:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4224  77 59304 44978325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:29:38 [DEBUG   ] Got command RPT from MCS: ref #4225
2021-03-31 12:29:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 12:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4225  12 59304 44978533 A  ERRORB˜™š'
2021-03-31 12:29:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2021-03-31 12:30:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 12:30:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:30:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:30:13 [DEBUG   ] Finished updating board flags in 1.582 seconds
2021-03-31 12:30:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-03-31 12:30:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 12:31:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 12:31:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:31:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:31:13 [DEBUG   ] Finished updating board flags in 1.433 seconds
2021-03-31 12:31:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 12:31:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 12:32:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 12:32:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:32:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:32:13 [DEBUG   ] Finished updating board flags in 1.407 seconds
2021-03-31 12:32:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 12:32:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 12:33:11 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 12:33:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:33:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:33:13 [DEBUG   ] Finished updating board flags in 1.364 seconds
2021-03-31 12:33:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 12:33:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 12:34:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 12:34:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:34:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:34:13 [DEBUG   ] Finished updating board flags in 1.375 seconds
2021-03-31 12:34:20 [DEBUG   ] Got command RPT from MCS: ref #4243
2021-03-31 12:34:20 [DEBUG   ] summary = ERROR
2021-03-31 12:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4243  13 59304 45260213 A  ERRORERROR'
2021-03-31 12:34:20 [DEBUG   ] Got command RPT from MCS: ref #4244
2021-03-31 12:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4244  77 59304 45260213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:34:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 12:34:37 [DEBUG   ] Got command RPT from MCS: ref #4260
2021-03-31 12:34:37 [DEBUG   ] summary = ERROR
2021-03-31 12:34:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4260  13 59304 45277801 A  ERRORERROR'
2021-03-31 12:34:38 [DEBUG   ] Got command RPT from MCS: ref #4261
2021-03-31 12:34:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4261  77 59304 45278005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:34:38 [DEBUG   ] Got command RPT from MCS: ref #4262
2021-03-31 12:34:38 [DEBUG   ] summary = ERROR
2021-03-31 12:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4262  13 59304 45278197 A  ERRORERROR'
2021-03-31 12:34:38 [DEBUG   ] Got command RPT from MCS: ref #4263
2021-03-31 12:34:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4263  77 59304 45278401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:34:38 [DEBUG   ] Got command RPT from MCS: ref #4264
2021-03-31 12:34:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 12:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4264  12 59304 45278605 A  ERRORB˜™š'
2021-03-31 12:34:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 12:35:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 12:35:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:35:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:35:14 [DEBUG   ] Finished updating board flags in 2.049 seconds
2021-03-31 12:35:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 12:35:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 12:36:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 12:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:36:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:36:14 [DEBUG   ] Finished updating board flags in 1.992 seconds
2021-03-31 12:36:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 12:36:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 12:37:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 12:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:37:14 [DEBUG   ] Finished updating board flags in 1.805 seconds
2021-03-31 12:37:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 12:37:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 12:38:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 12:38:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:38:14 [DEBUG   ] Finished updating board flags in 1.863 seconds
2021-03-31 12:38:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 12:38:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 12:39:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 12:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:39:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:39:14 [DEBUG   ] Finished updating board flags in 1.731 seconds
2021-03-31 12:39:20 [DEBUG   ] Got command RPT from MCS: ref #4271
2021-03-31 12:39:20 [DEBUG   ] summary = ERROR
2021-03-31 12:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4271  13 59304 45560217 A  ERRORERROR'
2021-03-31 12:39:20 [DEBUG   ] Got command RPT from MCS: ref #4272
2021-03-31 12:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4272  77 59304 45560217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:39:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2021-03-31 12:39:37 [DEBUG   ] Got command RPT from MCS: ref #4294
2021-03-31 12:39:37 [DEBUG   ] summary = ERROR
2021-03-31 12:39:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4294  13 59304 45577877 A  ERRORERROR'
2021-03-31 12:39:38 [DEBUG   ] Got command RPT from MCS: ref #4296
2021-03-31 12:39:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4296  77 59304 45578069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:39:38 [DEBUG   ] Got command RPT from MCS: ref #4298
2021-03-31 12:39:38 [DEBUG   ] summary = ERROR
2021-03-31 12:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4298  13 59304 45578273 A  ERRORERROR'
2021-03-31 12:39:38 [DEBUG   ] Got command RPT from MCS: ref #4299
2021-03-31 12:39:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4299  77 59304 45578477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:39:38 [DEBUG   ] Got command RPT from MCS: ref #4300
2021-03-31 12:39:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 12:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4300  12 59304 45578669 A  ERRORB˜™š'
2021-03-31 12:39:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 12:40:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 12:40:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:40:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:40:14 [DEBUG   ] Finished updating board flags in 1.613 seconds
2021-03-31 12:40:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 12:40:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 12:41:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 12:41:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:41:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:41:14 [DEBUG   ] Finished updating board flags in 1.607 seconds
2021-03-31 12:41:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 12:41:52 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 12:42:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 12:42:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:42:14 [DEBUG   ] Finished updating board flags in 1.614 seconds
2021-03-31 12:42:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 12:42:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 12:43:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 12:43:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:43:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:43:14 [DEBUG   ] Finished updating board flags in 1.583 seconds
2021-03-31 12:43:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 12:43:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 12:44:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 12:44:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:44:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:44:14 [DEBUG   ] Finished updating board flags in 1.417 seconds
2021-03-31 12:44:20 [DEBUG   ] Got command RPT from MCS: ref #4312
2021-03-31 12:44:20 [DEBUG   ] summary = ERROR
2021-03-31 12:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4312  13 59304 45860213 A  ERRORERROR'
2021-03-31 12:44:20 [DEBUG   ] Got command RPT from MCS: ref #4313
2021-03-31 12:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4313  77 59304 45860213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:44:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 12:44:37 [DEBUG   ] Got command RPT from MCS: ref #4329
2021-03-31 12:44:37 [DEBUG   ] summary = ERROR
2021-03-31 12:44:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4329  13 59304 45877949 A  ERRORERROR'
2021-03-31 12:44:38 [DEBUG   ] Got command RPT from MCS: ref #4330
2021-03-31 12:44:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4330  77 59304 45878141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:44:38 [DEBUG   ] Got command RPT from MCS: ref #4331
2021-03-31 12:44:38 [DEBUG   ] summary = ERROR
2021-03-31 12:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4331  13 59304 45878345 A  ERRORERROR'
2021-03-31 12:44:38 [DEBUG   ] Got command RPT from MCS: ref #4332
2021-03-31 12:44:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4332  77 59304 45878549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:44:38 [DEBUG   ] Got command RPT from MCS: ref #4333
2021-03-31 12:44:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 12:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4333  12 59304 45878753 A  ERRORB˜™š'
2021-03-31 12:44:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 12:45:13 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 12:45:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:45:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:45:14 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 12:45:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 12:45:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 12:46:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 12:46:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:46:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:46:14 [DEBUG   ] Finished updating board flags in 1.420 seconds
2021-03-31 12:46:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 12:46:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 12:47:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 12:47:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:47:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:47:14 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 12:47:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 12:47:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 12:48:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 12:48:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:48:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:48:14 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 12:48:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 12:48:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 12:49:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 12:49:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:49:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:49:14 [DEBUG   ] Finished updating board flags in 1.419 seconds
2021-03-31 12:49:20 [DEBUG   ] Got command RPT from MCS: ref #4346
2021-03-31 12:49:20 [DEBUG   ] summary = ERROR
2021-03-31 12:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4346  13 59304 46160213 A  ERRORERROR'
2021-03-31 12:49:20 [DEBUG   ] Got command RPT from MCS: ref #4347
2021-03-31 12:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4347  77 59304 46160213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:49:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 12:49:38 [DEBUG   ] Got command RPT from MCS: ref #4365
2021-03-31 12:49:38 [DEBUG   ] summary = ERROR
2021-03-31 12:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4365  13 59304 46178021 A  ERRORERROR'
2021-03-31 12:49:38 [DEBUG   ] Got command RPT from MCS: ref #4366
2021-03-31 12:49:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4366  77 59304 46178225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:49:38 [DEBUG   ] Got command RPT from MCS: ref #4367
2021-03-31 12:49:38 [DEBUG   ] summary = ERROR
2021-03-31 12:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4367  13 59304 46178417 A  ERRORERROR'
2021-03-31 12:49:38 [DEBUG   ] Got command RPT from MCS: ref #4368
2021-03-31 12:49:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4368  77 59304 46178621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:49:38 [DEBUG   ] Got command RPT from MCS: ref #4369
2021-03-31 12:49:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 12:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4369  12 59304 46178825 A  ERRORB—™š'
2021-03-31 12:49:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 12:50:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:50:14 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2021-03-31 12:50:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:50:14 [DEBUG   ] Finished updating board flags in 1.481 seconds
2021-03-31 12:50:34 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2021-03-31 12:50:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 12:51:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:51:14 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2021-03-31 12:51:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:51:14 [DEBUG   ] Finished updating board flags in 1.480 seconds
2021-03-31 12:51:34 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2021-03-31 12:51:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 12:52:14 [DEBUG   ] Finished updating ant stats in 0.858 seconds
2021-03-31 12:52:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:52:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:52:15 [DEBUG   ] Finished updating board flags in 2.180 seconds
2021-03-31 12:52:34 [DEBUG   ] Finished updating ant stats in 0.746 seconds
2021-03-31 12:52:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 12:53:14 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2021-03-31 12:53:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:53:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:53:15 [DEBUG   ] Finished updating board flags in 1.973 seconds
2021-03-31 12:53:34 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2021-03-31 12:53:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-03-31 12:54:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:54:15 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2021-03-31 12:54:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:54:15 [DEBUG   ] Finished updating board flags in 1.880 seconds
2021-03-31 12:54:20 [DEBUG   ] Got command RPT from MCS: ref #4381
2021-03-31 12:54:20 [DEBUG   ] summary = ERROR
2021-03-31 12:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4381  13 59304 46460217 A  ERRORERROR'
2021-03-31 12:54:20 [DEBUG   ] Got command RPT from MCS: ref #4382
2021-03-31 12:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4382  77 59304 46460217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:54:35 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2021-03-31 12:54:38 [DEBUG   ] Got command RPT from MCS: ref #4402
2021-03-31 12:54:38 [DEBUG   ] summary = ERROR
2021-03-31 12:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4402  13 59304 46478097 A  ERRORERROR'
2021-03-31 12:54:38 [DEBUG   ] Got command RPT from MCS: ref #4404
2021-03-31 12:54:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4404  77 59304 46478289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:54:38 [DEBUG   ] Got command RPT from MCS: ref #4406
2021-03-31 12:54:38 [DEBUG   ] summary = ERROR
2021-03-31 12:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4406  13 59304 46478493 A  ERRORERROR'
2021-03-31 12:54:38 [DEBUG   ] Got command RPT from MCS: ref #4407
2021-03-31 12:54:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4407  77 59304 46478697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:54:38 [DEBUG   ] Got command RPT from MCS: ref #4408
2021-03-31 12:54:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 12:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4408  12 59304 46478901 A  ERRORB˜™š'
2021-03-31 12:54:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 12:55:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 12:55:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:55:15 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2021-03-31 12:55:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:55:15 [DEBUG   ] Finished updating board flags in 1.782 seconds
2021-03-31 12:55:35 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2021-03-31 12:55:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 12:56:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:56:15 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2021-03-31 12:56:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:56:15 [DEBUG   ] Finished updating board flags in 1.621 seconds
2021-03-31 12:56:35 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2021-03-31 12:56:56 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 12:57:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:57:15 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2021-03-31 12:57:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:57:15 [DEBUG   ] Finished updating board flags in 1.579 seconds
2021-03-31 12:57:36 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2021-03-31 12:57:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 12:58:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:58:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 12:58:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:58:16 [DEBUG   ] Finished updating board flags in 2.564 seconds
2021-03-31 12:58:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 12:58:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 12:59:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 12:59:16 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2021-03-31 12:59:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 12:59:16 [DEBUG   ] Finished updating board flags in 2.245 seconds
2021-03-31 12:59:20 [DEBUG   ] Got command RPT from MCS: ref #4415
2021-03-31 12:59:20 [DEBUG   ] summary = ERROR
2021-03-31 12:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4415  13 59304 46760217 A  ERRORERROR'
2021-03-31 12:59:20 [DEBUG   ] Got command RPT from MCS: ref #4416
2021-03-31 12:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4416  77 59304 46760217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:59:36 [DEBUG   ] Finished updating ant stats in 0.961 seconds
2021-03-31 12:59:38 [DEBUG   ] Got command RPT from MCS: ref #4434
2021-03-31 12:59:38 [DEBUG   ] summary = ERROR
2021-03-31 12:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4434  13 59304 46778173 A  ERRORERROR'
2021-03-31 12:59:38 [DEBUG   ] Got command RPT from MCS: ref #4435
2021-03-31 12:59:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4435  77 59304 46778365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:59:38 [DEBUG   ] Got command RPT from MCS: ref #4436
2021-03-31 12:59:38 [DEBUG   ] summary = ERROR
2021-03-31 12:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4436  13 59304 46778569 A  ERRORERROR'
2021-03-31 12:59:38 [DEBUG   ] Got command RPT from MCS: ref #4437
2021-03-31 12:59:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 12:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4437  77 59304 46778773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 12:59:38 [DEBUG   ] Got command RPT from MCS: ref #4438
2021-03-31 12:59:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 12:59:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4438  12 59304 46778965 A  ERRORB˜™š'
2021-03-31 12:59:56 [DEBUG   ] Finished updating ant stats in 0.767 seconds
2021-03-31 13:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:00:16 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2021-03-31 13:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:00:16 [DEBUG   ] Finished updating board flags in 2.213 seconds
2021-03-31 13:00:36 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2021-03-31 13:00:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 13:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:01:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:01:16 [DEBUG   ] Finished updating board flags in 2.158 seconds
2021-03-31 13:01:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 13:01:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 13:01:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 13:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:02:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:02:16 [DEBUG   ] Finished updating board flags in 2.036 seconds
2021-03-31 13:02:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 13:02:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 13:02:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 13:03:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:03:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:03:16 [DEBUG   ] Finished updating board flags in 1.966 seconds
2021-03-31 13:03:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-03-31 13:03:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 13:03:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 13:04:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:04:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:04:16 [DEBUG   ] Finished updating board flags in 1.794 seconds
2021-03-31 13:04:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:04:20 [DEBUG   ] Got command RPT from MCS: ref #4456
2021-03-31 13:04:20 [DEBUG   ] summary = ERROR
2021-03-31 13:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4456  13 59304 47060221 A  ERRORERROR'
2021-03-31 13:04:20 [DEBUG   ] Got command RPT from MCS: ref #4457
2021-03-31 13:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4457  77 59304 47060221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:04:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 13:04:38 [DEBUG   ] Got command RPT from MCS: ref #4473
2021-03-31 13:04:38 [DEBUG   ] summary = ERROR
2021-03-31 13:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4473  13 59304 47078241 A  ERRORERROR'
2021-03-31 13:04:38 [DEBUG   ] Got command RPT from MCS: ref #4474
2021-03-31 13:04:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4474  77 59304 47078445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:04:38 [DEBUG   ] Got command RPT from MCS: ref #4475
2021-03-31 13:04:38 [DEBUG   ] summary = ERROR
2021-03-31 13:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4475  13 59304 47078637 A  ERRORERROR'
2021-03-31 13:04:38 [DEBUG   ] Got command RPT from MCS: ref #4476
2021-03-31 13:04:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:04:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4476  77 59304 47078841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:04:39 [DEBUG   ] Got command RPT from MCS: ref #4477
2021-03-31 13:04:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:04:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4477  12 59304 47079045 A  ERRORB˜™š'
2021-03-31 13:04:57 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 13:05:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:05:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:05:16 [DEBUG   ] Finished updating board flags in 1.654 seconds
2021-03-31 13:05:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 13:05:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 13:05:58 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2021-03-31 13:06:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:06:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:06:16 [DEBUG   ] Finished updating board flags in 1.526 seconds
2021-03-31 13:06:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 13:06:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 13:06:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 13:07:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:07:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:07:16 [DEBUG   ] Finished updating board flags in 1.410 seconds
2021-03-31 13:07:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:07:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:07:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:08:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:08:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:08:16 [DEBUG   ] Finished updating board flags in 1.392 seconds
2021-03-31 13:08:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 13:08:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-03-31 13:08:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 13:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:09:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:09:16 [DEBUG   ] Finished updating board flags in 1.370 seconds
2021-03-31 13:09:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 13:09:20 [DEBUG   ] Got command RPT from MCS: ref #4484
2021-03-31 13:09:20 [DEBUG   ] summary = ERROR
2021-03-31 13:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4484  13 59304 47360221 A  ERRORERROR'
2021-03-31 13:09:20 [DEBUG   ] Got command RPT from MCS: ref #4485
2021-03-31 13:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4485  77 59304 47360221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:09:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 13:09:38 [DEBUG   ] Got command RPT from MCS: ref #4507
2021-03-31 13:09:38 [DEBUG   ] summary = ERROR
2021-03-31 13:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4507  13 59304 47378321 A  ERRORERROR'
2021-03-31 13:09:38 [DEBUG   ] Got command RPT from MCS: ref #4509
2021-03-31 13:09:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4509  77 59304 47378513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:09:38 [DEBUG   ] Got command RPT from MCS: ref #4511
2021-03-31 13:09:38 [DEBUG   ] summary = ERROR
2021-03-31 13:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4511  13 59304 47378717 A  ERRORERROR'
2021-03-31 13:09:38 [DEBUG   ] Got command RPT from MCS: ref #4512
2021-03-31 13:09:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:09:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4512  77 59304 47378921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:09:39 [DEBUG   ] Got command RPT from MCS: ref #4513
2021-03-31 13:09:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4513  12 59304 47379113 A  ERRORB—™š'
2021-03-31 13:09:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 13:10:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:10:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:10:17 [DEBUG   ] Finished updating board flags in 2.062 seconds
2021-03-31 13:10:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:10:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 13:10:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 13:11:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:11:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:11:17 [DEBUG   ] Finished updating board flags in 1.983 seconds
2021-03-31 13:11:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 13:11:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 13:11:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 13:12:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:12:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:12:17 [DEBUG   ] Finished updating board flags in 1.813 seconds
2021-03-31 13:12:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 13:12:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 13:12:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 13:13:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:13:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:13:17 [DEBUG   ] Finished updating board flags in 1.806 seconds
2021-03-31 13:13:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 13:13:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 13:13:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:14:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:14:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:14:17 [DEBUG   ] Finished updating board flags in 1.798 seconds
2021-03-31 13:14:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:14:20 [DEBUG   ] Got command RPT from MCS: ref #4525
2021-03-31 13:14:20 [DEBUG   ] summary = ERROR
2021-03-31 13:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4525  13 59304 47660217 A  ERRORERROR'
2021-03-31 13:14:20 [DEBUG   ] Got command RPT from MCS: ref #4526
2021-03-31 13:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4526  77 59304 47660217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:14:38 [DEBUG   ] Got command RPT from MCS: ref #4542
2021-03-31 13:14:38 [DEBUG   ] summary = ERROR
2021-03-31 13:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4542  13 59304 47678385 A  ERRORERROR'
2021-03-31 13:14:38 [DEBUG   ] Got command RPT from MCS: ref #4543
2021-03-31 13:14:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4543  77 59304 47678589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:14:38 [DEBUG   ] Got command RPT from MCS: ref #4544
2021-03-31 13:14:38 [DEBUG   ] summary = ERROR
2021-03-31 13:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4544  13 59304 47678793 A  ERRORERROR'
2021-03-31 13:14:38 [DEBUG   ] Got command RPT from MCS: ref #4545
2021-03-31 13:14:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:14:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4545  77 59304 47678997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:14:39 [DEBUG   ] Got command RPT from MCS: ref #4546
2021-03-31 13:14:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4546  12 59304 47679189 A  ERRORB˜™š'
2021-03-31 13:14:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 13:14:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 13:15:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:15:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:15:17 [DEBUG   ] Finished updating board flags in 1.590 seconds
2021-03-31 13:15:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 13:15:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 13:15:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 13:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:16:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:16:17 [DEBUG   ] Finished updating board flags in 1.461 seconds
2021-03-31 13:16:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 13:16:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:16:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:17:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:17:17 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 13:17:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 13:17:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 13:18:00 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 13:18:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:18:17 [DEBUG   ] Finished updating board flags in 1.420 seconds
2021-03-31 13:18:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 13:18:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:19:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:19:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:19:17 [DEBUG   ] Finished updating board flags in 1.407 seconds
2021-03-31 13:19:20 [DEBUG   ] Got command RPT from MCS: ref #4559
2021-03-31 13:19:20 [DEBUG   ] summary = ERROR
2021-03-31 13:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4559  13 59304 47960229 A  ERRORERROR'
2021-03-31 13:19:20 [DEBUG   ] Got command RPT from MCS: ref #4560
2021-03-31 13:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4560  77 59304 47960229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:19:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:19:38 [DEBUG   ] Got command RPT from MCS: ref #4578
2021-03-31 13:19:38 [DEBUG   ] summary = ERROR
2021-03-31 13:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4578  13 59304 47978469 A  ERRORERROR'
2021-03-31 13:19:38 [DEBUG   ] Got command RPT from MCS: ref #4579
2021-03-31 13:19:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4579  77 59304 47978661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:19:38 [DEBUG   ] Got command RPT from MCS: ref #4580
2021-03-31 13:19:38 [DEBUG   ] summary = ERROR
2021-03-31 13:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4580  13 59304 47978865 A  ERRORERROR'
2021-03-31 13:19:39 [DEBUG   ] Got command RPT from MCS: ref #4581
2021-03-31 13:19:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4581  77 59304 47979069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:19:39 [DEBUG   ] Got command RPT from MCS: ref #4582
2021-03-31 13:19:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4582  12 59304 47979261 A  ERRORB—™š'
2021-03-31 13:19:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 13:20:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 13:20:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:20:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:20:17 [DEBUG   ] Finished updating board flags in 1.411 seconds
2021-03-31 13:20:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 13:20:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 13:21:01 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2021-03-31 13:21:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:21:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:21:17 [DEBUG   ] Finished updating board flags in 1.409 seconds
2021-03-31 13:21:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 13:21:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 13:22:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 13:22:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:22:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:22:17 [DEBUG   ] Finished updating board flags in 1.418 seconds
2021-03-31 13:22:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 13:22:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 13:23:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2021-03-31 13:23:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:23:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:23:17 [DEBUG   ] Finished updating board flags in 1.418 seconds
2021-03-31 13:23:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 13:23:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 13:24:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2021-03-31 13:24:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:24:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:24:17 [DEBUG   ] Finished updating board flags in 1.413 seconds
2021-03-31 13:24:20 [DEBUG   ] Got command RPT from MCS: ref #4594
2021-03-31 13:24:20 [DEBUG   ] summary = ERROR
2021-03-31 13:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4594  13 59304 48260229 A  ERRORERROR'
2021-03-31 13:24:20 [DEBUG   ] Got command RPT from MCS: ref #4595
2021-03-31 13:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4595  77 59304 48260229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:24:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-03-31 13:24:38 [DEBUG   ] Got command RPT from MCS: ref #4615
2021-03-31 13:24:38 [DEBUG   ] summary = ERROR
2021-03-31 13:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4615  13 59304 48278533 A  ERRORERROR'
2021-03-31 13:24:38 [DEBUG   ] Got command RPT from MCS: ref #4617
2021-03-31 13:24:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4617  77 59304 48278737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:24:38 [DEBUG   ] Got command RPT from MCS: ref #4619
2021-03-31 13:24:38 [DEBUG   ] summary = ERROR
2021-03-31 13:24:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4619  13 59304 48278929 A  ERRORERROR'
2021-03-31 13:24:39 [DEBUG   ] Got command RPT from MCS: ref #4620
2021-03-31 13:24:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4620  77 59304 48279133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:24:39 [DEBUG   ] Got command RPT from MCS: ref #4621
2021-03-31 13:24:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4621  12 59304 48279337 A  ERRORB˜™š'
2021-03-31 13:24:41 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 13:25:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:25:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:25:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:25:17 [DEBUG   ] Finished updating board flags in 1.418 seconds
2021-03-31 13:25:21 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:25:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:26:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 13:26:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:26:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:26:17 [DEBUG   ] Finished updating board flags in 1.461 seconds
2021-03-31 13:26:22 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 13:26:42 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 13:27:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 13:27:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:27:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:27:18 [DEBUG   ] Finished updating board flags in 2.254 seconds
2021-03-31 13:27:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 13:27:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 13:28:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 13:28:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:28:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:28:18 [DEBUG   ] Finished updating board flags in 2.103 seconds
2021-03-31 13:28:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:28:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 13:29:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:29:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:29:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:29:18 [DEBUG   ] Finished updating board flags in 2.021 seconds
2021-03-31 13:29:20 [DEBUG   ] Got command RPT from MCS: ref #4628
2021-03-31 13:29:20 [DEBUG   ] summary = ERROR
2021-03-31 13:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4628  13 59304 48560225 A  ERRORERROR'
2021-03-31 13:29:20 [DEBUG   ] Got command RPT from MCS: ref #4629
2021-03-31 13:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4629  77 59304 48560225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:29:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 13:29:38 [DEBUG   ] Got command RPT from MCS: ref #4647
2021-03-31 13:29:38 [DEBUG   ] summary = ERROR
2021-03-31 13:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4647  13 59304 48578609 A  ERRORERROR'
2021-03-31 13:29:38 [DEBUG   ] Got command RPT from MCS: ref #4648
2021-03-31 13:29:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:29:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4648  77 59304 48578813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:29:39 [DEBUG   ] Got command RPT from MCS: ref #4649
2021-03-31 13:29:39 [DEBUG   ] summary = ERROR
2021-03-31 13:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4649  13 59304 48579005 A  ERRORERROR'
2021-03-31 13:29:39 [DEBUG   ] Got command RPT from MCS: ref #4650
2021-03-31 13:29:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4650  77 59304 48579209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:29:39 [DEBUG   ] Got command RPT from MCS: ref #4651
2021-03-31 13:29:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4651  12 59304 48579413 A  ERRORB˜™š'
2021-03-31 13:29:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 13:30:00 [DEBUG   ] Got command TBN from MCS: ref #4657
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] tbn = exited with status True, code 0x00
2021-03-31 13:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     4657   8 59304 48600141 A  ERROR'
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1617197401']
2021-03-31 13:30:00 [DEBUG   ] spawn_process: at 2021-03-31 13:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1617197401']
2021-03-31 13:30:00 [INFO    ] Finished spawning TBN in 0.054 s
2021-03-31 13:30:02 [DEBUG   ] Finished updating ant stats in 0.737 seconds
2021-03-31 13:30:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:30:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:30:18 [DEBUG   ] Finished updating board flags in 1.989 seconds
2021-03-31 13:30:22 [DEBUG   ] Finished updating ant stats in 0.662 seconds
2021-03-31 13:30:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 13:31:02 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2021-03-31 13:31:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:31:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:31:18 [DEBUG   ] Finished updating board flags in 1.810 seconds
2021-03-31 13:31:22 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2021-03-31 13:31:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 13:32:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 13:32:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:32:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:32:18 [DEBUG   ] Finished updating board flags in 1.803 seconds
2021-03-31 13:32:23 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2021-03-31 13:32:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:33:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 13:33:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:33:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:33:18 [DEBUG   ] Finished updating board flags in 1.799 seconds
2021-03-31 13:33:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:33:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 13:34:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 13:34:11 [DEBUG   ] Got command TBW from MCS: ref #4671
2021-03-31 13:34:11 [DEBUG   ] tbw = exited with status True, code 0x00
2021-03-31 13:34:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW     4671   8 59304 48851217 A  ERROR'
2021-03-31 13:34:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2021-03-31 13:34:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2021-03-31 13:34:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2021-03-31 13:34:14 [DEBUG   ] spawn_process: at 2021-03-31 13:34:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2021-03-31 13:34:14 [INFO    ] Finished spawning TBW
2021-03-31 13:34:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:34:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:34:18 [DEBUG   ] Finished updating board flags in 1.411 seconds
2021-03-31 13:34:20 [DEBUG   ] Got command RPT from MCS: ref #4673
2021-03-31 13:34:20 [DEBUG   ] summary = ERROR
2021-03-31 13:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4673  13 59304 48860229 A  ERRORERROR'
2021-03-31 13:34:20 [DEBUG   ] Got command RPT from MCS: ref #4674
2021-03-31 13:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4674  77 59304 48860229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:34:38 [DEBUG   ] Got command RPT from MCS: ref #4690
2021-03-31 13:34:38 [DEBUG   ] summary = ERROR
2021-03-31 13:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4690  13 59304 48878685 A  ERRORERROR'
2021-03-31 13:34:38 [DEBUG   ] Got command RPT from MCS: ref #4691
2021-03-31 13:34:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:34:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4691  77 59304 48878877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:34:39 [DEBUG   ] Got command RPT from MCS: ref #4692
2021-03-31 13:34:39 [DEBUG   ] summary = ERROR
2021-03-31 13:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4692  13 59304 48879081 A  ERRORERROR'
2021-03-31 13:34:39 [DEBUG   ] Got command RPT from MCS: ref #4693
2021-03-31 13:34:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4693  77 59304 48879285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:34:39 [DEBUG   ] Got command RPT from MCS: ref #4694
2021-03-31 13:34:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4694  12 59304 48879477 A  ERRORB˜™š'
2021-03-31 13:35:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:35:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:35:18 [DEBUG   ] Finished updating board flags in 1.567 seconds
2021-03-31 13:36:02 [INFO    ] __waitForTBW - TBW finished in 108.052 s
2021-03-31 13:36:03 [DEBUG   ] Finished updating ant stats in 0.501 seconds
2021-03-31 13:36:03 [INFO    ] Started antennas statistics background thread
2021-03-31 13:36:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1617197765']
2021-03-31 13:36:03 [DEBUG   ] spawn_process: at 2021-03-31 13:36:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1617197765']
2021-03-31 13:36:03 [INFO    ] Finished spawning TBN in 0.049 s
2021-03-31 13:36:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:36:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:36:18 [DEBUG   ] Finished updating board flags in 1.631 seconds
2021-03-31 13:36:23 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2021-03-31 13:36:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 13:37:04 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-03-31 13:37:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:37:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:37:18 [DEBUG   ] Finished updating board flags in 1.622 seconds
2021-03-31 13:37:24 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 13:37:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 13:38:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 13:38:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:38:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:38:18 [DEBUG   ] Finished updating board flags in 1.658 seconds
2021-03-31 13:38:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 13:38:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:39:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:39:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:39:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:39:18 [DEBUG   ] Finished updating board flags in 1.653 seconds
2021-03-31 13:39:20 [DEBUG   ] Got command RPT from MCS: ref #4707
2021-03-31 13:39:20 [DEBUG   ] summary = ERROR
2021-03-31 13:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4707  13 59304 49160225 A  ERRORERROR'
2021-03-31 13:39:20 [DEBUG   ] Got command RPT from MCS: ref #4708
2021-03-31 13:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4708  77 59304 49160225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:39:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:39:38 [DEBUG   ] Got command RPT from MCS: ref #4730
2021-03-31 13:39:38 [DEBUG   ] summary = ERROR
2021-03-31 13:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4730  13 59304 49178777 A  ERRORERROR'
2021-03-31 13:39:38 [DEBUG   ] Got command RPT from MCS: ref #4732
2021-03-31 13:39:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4732  77 59304 49178981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:39:39 [DEBUG   ] Got command RPT from MCS: ref #4734
2021-03-31 13:39:39 [DEBUG   ] summary = ERROR
2021-03-31 13:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4734  13 59304 49179173 A  ERRORERROR'
2021-03-31 13:39:39 [DEBUG   ] Got command RPT from MCS: ref #4735
2021-03-31 13:39:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4735  77 59304 49179377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:39:39 [DEBUG   ] Got command RPT from MCS: ref #4736
2021-03-31 13:39:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4736  12 59304 49179581 A  ERRORB—™š'
2021-03-31 13:39:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 13:40:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 13:40:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:40:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:40:19 [DEBUG   ] Finished updating board flags in 1.642 seconds
2021-03-31 13:40:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 13:40:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 13:41:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 13:41:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:41:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:41:19 [DEBUG   ] Finished updating board flags in 1.634 seconds
2021-03-31 13:41:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 13:41:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 13:42:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 13:42:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:42:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:42:19 [DEBUG   ] Finished updating board flags in 1.657 seconds
2021-03-31 13:42:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 13:42:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 13:43:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 13:43:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:43:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:43:19 [DEBUG   ] Finished updating board flags in 2.290 seconds
2021-03-31 13:43:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:43:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 13:44:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 13:44:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:44:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:44:19 [DEBUG   ] Finished updating board flags in 2.146 seconds
2021-03-31 13:44:20 [DEBUG   ] Got command RPT from MCS: ref #4748
2021-03-31 13:44:20 [DEBUG   ] summary = ERROR
2021-03-31 13:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4748  13 59304 49460225 A  ERRORERROR'
2021-03-31 13:44:20 [DEBUG   ] Got command RPT from MCS: ref #4749
2021-03-31 13:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4749  77 59304 49460225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:44:25 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 13:44:38 [DEBUG   ] Got command RPT from MCS: ref #4765
2021-03-31 13:44:38 [DEBUG   ] summary = ERROR
2021-03-31 13:44:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4765  13 59304 49478849 A  ERRORERROR'
2021-03-31 13:44:39 [DEBUG   ] Got command RPT from MCS: ref #4766
2021-03-31 13:44:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:44:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4766  77 59304 49479053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:44:39 [DEBUG   ] Got command RPT from MCS: ref #4767
2021-03-31 13:44:39 [DEBUG   ] summary = ERROR
2021-03-31 13:44:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4767  13 59304 49479257 A  ERRORERROR'
2021-03-31 13:44:39 [DEBUG   ] Got command RPT from MCS: ref #4768
2021-03-31 13:44:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:44:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4768  77 59304 49479449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:44:39 [DEBUG   ] Got command RPT from MCS: ref #4769
2021-03-31 13:44:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:44:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4769  12 59304 49479653 A  ERRORB˜™š'
2021-03-31 13:44:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 13:45:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 13:45:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:45:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:45:19 [DEBUG   ] Finished updating board flags in 1.918 seconds
2021-03-31 13:45:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 13:45:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 13:46:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 13:46:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:46:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:46:19 [DEBUG   ] Finished updating board flags in 1.816 seconds
2021-03-31 13:46:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 13:46:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:47:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:47:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:47:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:47:19 [DEBUG   ] Finished updating board flags in 1.776 seconds
2021-03-31 13:47:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:47:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 13:48:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:48:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:48:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:48:19 [DEBUG   ] Finished updating board flags in 1.622 seconds
2021-03-31 13:48:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 13:48:45 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-03-31 13:49:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 13:49:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:49:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:49:19 [DEBUG   ] Finished updating board flags in 1.582 seconds
2021-03-31 13:49:20 [DEBUG   ] Got command RPT from MCS: ref #4786
2021-03-31 13:49:20 [DEBUG   ] summary = ERROR
2021-03-31 13:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4786  13 59304 49760233 A  ERRORERROR'
2021-03-31 13:49:20 [DEBUG   ] Got command RPT from MCS: ref #4787
2021-03-31 13:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4787  77 59304 49760233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:49:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 13:49:38 [DEBUG   ] Got command RPT from MCS: ref #4806
2021-03-31 13:49:38 [DEBUG   ] summary = ERROR
2021-03-31 13:49:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4806  13 59304 49778929 A  ERRORERROR'
2021-03-31 13:49:39 [DEBUG   ] Got command RPT from MCS: ref #4807
2021-03-31 13:49:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4807  77 59304 49779121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:49:39 [DEBUG   ] Got command RPT from MCS: ref #4808
2021-03-31 13:49:39 [DEBUG   ] summary = ERROR
2021-03-31 13:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4808  13 59304 49779325 A  ERRORERROR'
2021-03-31 13:49:39 [DEBUG   ] Got command RPT from MCS: ref #4809
2021-03-31 13:49:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4809  77 59304 49779529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:49:39 [DEBUG   ] Got command RPT from MCS: ref #4810
2021-03-31 13:49:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4810  12 59304 49779721 A  ERRORB˜™š'
2021-03-31 13:49:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 13:50:05 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2021-03-31 13:50:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:50:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:50:19 [DEBUG   ] Finished updating board flags in 1.418 seconds
2021-03-31 13:50:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 13:50:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:51:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 13:51:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:51:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:51:19 [DEBUG   ] Finished updating board flags in 1.393 seconds
2021-03-31 13:51:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 13:51:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 13:52:06 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2021-03-31 13:52:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:52:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:52:19 [DEBUG   ] Finished updating board flags in 1.362 seconds
2021-03-31 13:52:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 13:52:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 13:53:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 13:53:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:53:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:53:20 [DEBUG   ] Finished updating board flags in 2.051 seconds
2021-03-31 13:53:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 13:53:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:54:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 13:54:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:54:20 [DEBUG   ] Got command RPT from MCS: ref #4827
2021-03-31 13:54:20 [DEBUG   ] summary = ERROR
2021-03-31 13:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4827  13 59304 50060233 A  ERRORERROR'
2021-03-31 13:54:20 [DEBUG   ] Got command RPT from MCS: ref #4828
2021-03-31 13:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4828  77 59304 50060233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:54:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:54:20 [DEBUG   ] Finished updating board flags in 1.990 seconds
2021-03-31 13:54:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 13:54:38 [DEBUG   ] Got command RPT from MCS: ref #4848
2021-03-31 13:54:38 [DEBUG   ] summary = ERROR
2021-03-31 13:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4848  13 59304 50078997 A  ERRORERROR'
2021-03-31 13:54:39 [DEBUG   ] Got command RPT from MCS: ref #4850
2021-03-31 13:54:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:54:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4850  77 59304 50079227 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:54:39 [DEBUG   ] Got command RPT from MCS: ref #4852
2021-03-31 13:54:39 [DEBUG   ] summary = ERROR
2021-03-31 13:54:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4852  13 59304 50079393 A  ERRORERROR'
2021-03-31 13:54:39 [DEBUG   ] Got command RPT from MCS: ref #4853
2021-03-31 13:54:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:54:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4853  77 59304 50079597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:54:39 [DEBUG   ] Got command RPT from MCS: ref #4854
2021-03-31 13:54:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:54:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4854  12 59304 50079801 A  ERRORB—™š'
2021-03-31 13:54:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 13:55:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 13:55:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:55:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:55:20 [DEBUG   ] Finished updating board flags in 1.815 seconds
2021-03-31 13:55:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 13:55:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 13:56:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 13:56:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:56:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:56:20 [DEBUG   ] Finished updating board flags in 1.808 seconds
2021-03-31 13:56:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 13:56:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 13:57:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2021-03-31 13:57:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:57:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:57:20 [DEBUG   ] Finished updating board flags in 1.786 seconds
2021-03-31 13:57:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 13:57:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 13:58:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 13:58:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:58:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:58:20 [DEBUG   ] Finished updating board flags in 1.617 seconds
2021-03-31 13:58:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 13:58:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 13:59:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 13:59:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 13:59:20 [DEBUG   ] Got command RPT from MCS: ref #4861
2021-03-31 13:59:20 [DEBUG   ] summary = ERROR
2021-03-31 13:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4861  13 59304 50360229 A  ERRORERROR'
2021-03-31 13:59:20 [DEBUG   ] Got command RPT from MCS: ref #4862
2021-03-31 13:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4862  77 59304 50360229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:59:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 13:59:20 [DEBUG   ] Finished updating board flags in 1.658 seconds
2021-03-31 13:59:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 13:59:39 [DEBUG   ] Got command RPT from MCS: ref #4880
2021-03-31 13:59:39 [DEBUG   ] summary = ERROR
2021-03-31 13:59:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4880  13 59304 50379069 A  ERRORERROR'
2021-03-31 13:59:39 [DEBUG   ] Got command RPT from MCS: ref #4881
2021-03-31 13:59:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:59:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4881  77 59304 50379273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:59:39 [DEBUG   ] Got command RPT from MCS: ref #4882
2021-03-31 13:59:39 [DEBUG   ] summary = ERROR
2021-03-31 13:59:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4882  13 59304 50379465 A  ERRORERROR'
2021-03-31 13:59:39 [DEBUG   ] Got command RPT from MCS: ref #4883
2021-03-31 13:59:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 13:59:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4883  77 59304 50379669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 13:59:39 [DEBUG   ] Got command RPT from MCS: ref #4884
2021-03-31 13:59:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 13:59:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4884  12 59304 50379873 A  ERRORB˜™š'
2021-03-31 13:59:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 14:00:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:00:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:00:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:00:20 [DEBUG   ] Finished updating board flags in 1.534 seconds
2021-03-31 14:00:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:00:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:01:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 14:01:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:01:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:01:20 [DEBUG   ] Finished updating board flags in 1.474 seconds
2021-03-31 14:01:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:01:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:02:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 14:02:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:02:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:02:20 [DEBUG   ] Finished updating board flags in 1.475 seconds
2021-03-31 14:02:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 14:02:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 14:03:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 14:03:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:03:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:03:20 [DEBUG   ] Finished updating board flags in 1.462 seconds
2021-03-31 14:03:27 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2021-03-31 14:03:48 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-03-31 14:04:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 14:04:20 [DEBUG   ] Got command RPT from MCS: ref #4902
2021-03-31 14:04:20 [DEBUG   ] summary = ERROR
2021-03-31 14:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4902  13 59304 50660241 A  ERRORERROR'
2021-03-31 14:04:20 [DEBUG   ] Got command RPT from MCS: ref #4903
2021-03-31 14:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4903  77 59304 50660241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:04:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:04:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:04:21 [DEBUG   ] Finished updating board flags in 2.239 seconds
2021-03-31 14:04:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 14:04:39 [DEBUG   ] Got command RPT from MCS: ref #4919
2021-03-31 14:04:39 [DEBUG   ] summary = ERROR
2021-03-31 14:04:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4919  13 59304 50679141 A  ERRORERROR'
2021-03-31 14:04:39 [DEBUG   ] Got command RPT from MCS: ref #4920
2021-03-31 14:04:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:04:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4920  77 59304 50679345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:04:39 [DEBUG   ] Got command RPT from MCS: ref #4921
2021-03-31 14:04:39 [DEBUG   ] summary = ERROR
2021-03-31 14:04:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4921  13 59304 50679537 A  ERRORERROR'
2021-03-31 14:04:39 [DEBUG   ] Got command RPT from MCS: ref #4922
2021-03-31 14:04:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:04:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4922  77 59304 50679741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:04:39 [DEBUG   ] Got command RPT from MCS: ref #4923
2021-03-31 14:04:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:04:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4923  12 59304 50679945 A  ERRORB–™š'
2021-03-31 14:04:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 14:05:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:05:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:05:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:05:21 [DEBUG   ] Finished updating board flags in 2.151 seconds
2021-03-31 14:05:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:05:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:06:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 14:06:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:06:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:06:21 [DEBUG   ] Finished updating board flags in 2.026 seconds
2021-03-31 14:06:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:06:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 14:07:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:07:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:07:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:07:21 [DEBUG   ] Finished updating board flags in 1.978 seconds
2021-03-31 14:07:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 14:07:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 14:08:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 14:08:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:08:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:08:21 [DEBUG   ] Finished updating board flags in 1.808 seconds
2021-03-31 14:08:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:08:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 14:09:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:09:20 [DEBUG   ] Got command RPT from MCS: ref #4930
2021-03-31 14:09:20 [DEBUG   ] summary = ERROR
2021-03-31 14:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4930  13 59304 50960233 A  ERRORERROR'
2021-03-31 14:09:20 [DEBUG   ] Got command RPT from MCS: ref #4931
2021-03-31 14:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4931  77 59304 50960233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:09:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:09:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:09:21 [DEBUG   ] Finished updating board flags in 1.811 seconds
2021-03-31 14:09:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 14:09:39 [DEBUG   ] Got command RPT from MCS: ref #4953
2021-03-31 14:09:39 [DEBUG   ] summary = ERROR
2021-03-31 14:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4953  13 59304 50979217 A  ERRORERROR'
2021-03-31 14:09:39 [DEBUG   ] Got command RPT from MCS: ref #4955
2021-03-31 14:09:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4955  77 59304 50979409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:09:39 [DEBUG   ] Got command RPT from MCS: ref #4957
2021-03-31 14:09:39 [DEBUG   ] summary = ERROR
2021-03-31 14:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4957  13 59304 50979613 A  ERRORERROR'
2021-03-31 14:09:39 [DEBUG   ] Got command RPT from MCS: ref #4958
2021-03-31 14:09:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4958  77 59304 50979817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:09:40 [DEBUG   ] Got command RPT from MCS: ref #4959
2021-03-31 14:09:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4959  12 59304 50980021 A  ERRORB˜™š'
2021-03-31 14:09:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 14:10:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 14:10:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:10:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:10:21 [DEBUG   ] Finished updating board flags in 1.878 seconds
2021-03-31 14:10:28 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-03-31 14:10:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 14:11:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 14:11:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:11:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:11:21 [DEBUG   ] Finished updating board flags in 1.723 seconds
2021-03-31 14:11:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 14:11:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 14:12:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:12:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:12:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:12:21 [DEBUG   ] Finished updating board flags in 1.599 seconds
2021-03-31 14:12:29 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 14:12:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 14:13:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 14:13:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:13:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:13:21 [DEBUG   ] Finished updating board flags in 1.494 seconds
2021-03-31 14:13:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 14:13:49 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2021-03-31 14:14:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 14:14:20 [DEBUG   ] Got command RPT from MCS: ref #4971
2021-03-31 14:14:20 [DEBUG   ] summary = ERROR
2021-03-31 14:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4971  13 59304 51260233 A  ERRORERROR'
2021-03-31 14:14:20 [DEBUG   ] Got command RPT from MCS: ref #4972
2021-03-31 14:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4972  77 59304 51260233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:14:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:14:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:14:21 [DEBUG   ] Finished updating board flags in 1.346 seconds
2021-03-31 14:14:30 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2021-03-31 14:14:39 [DEBUG   ] Got command RPT from MCS: ref #4988
2021-03-31 14:14:39 [DEBUG   ] summary = ERROR
2021-03-31 14:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4988  13 59304 51279289 A  ERRORERROR'
2021-03-31 14:14:39 [DEBUG   ] Got command RPT from MCS: ref #4989
2021-03-31 14:14:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4989  77 59304 51279493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:14:39 [DEBUG   ] Got command RPT from MCS: ref #4990
2021-03-31 14:14:39 [DEBUG   ] summary = ERROR
2021-03-31 14:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4990  13 59304 51279685 A  ERRORERROR'
2021-03-31 14:14:39 [DEBUG   ] Got command RPT from MCS: ref #4991
2021-03-31 14:14:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4991  77 59304 51279889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:14:40 [DEBUG   ] Got command RPT from MCS: ref #4992
2021-03-31 14:14:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:14:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     4992  12 59304 51280093 A  ERRORB˜™š'
2021-03-31 14:14:50 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 14:15:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 14:15:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:15:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:15:22 [DEBUG   ] Finished updating board flags in 2.167 seconds
2021-03-31 14:15:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 14:15:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 14:16:10 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-03-31 14:16:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:16:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:16:22 [DEBUG   ] Finished updating board flags in 2.003 seconds
2021-03-31 14:16:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 14:16:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:17:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 14:17:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:17:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:17:22 [DEBUG   ] Finished updating board flags in 1.995 seconds
2021-03-31 14:17:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:17:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:18:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 14:18:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 14:18:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:18:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:18:22 [DEBUG   ] Finished updating board flags in 1.814 seconds
2021-03-31 14:18:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 14:18:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 14:19:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 14:19:20 [DEBUG   ] Got command RPT from MCS: ref #5005
2021-03-31 14:19:20 [DEBUG   ] summary = ERROR
2021-03-31 14:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5005  13 59304 51560241 A  ERRORERROR'
2021-03-31 14:19:20 [DEBUG   ] Got command RPT from MCS: ref #5006
2021-03-31 14:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5006  77 59304 51560241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:19:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:19:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:19:22 [DEBUG   ] Finished updating board flags in 1.792 seconds
2021-03-31 14:19:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2021-03-31 14:19:39 [DEBUG   ] Got command RPT from MCS: ref #5024
2021-03-31 14:19:39 [DEBUG   ] summary = ERROR
2021-03-31 14:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5024  13 59304 51579357 A  ERRORERROR'
2021-03-31 14:19:39 [DEBUG   ] Got command RPT from MCS: ref #5025
2021-03-31 14:19:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5025  77 59304 51579561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:19:39 [DEBUG   ] Got command RPT from MCS: ref #5026
2021-03-31 14:19:39 [DEBUG   ] summary = ERROR
2021-03-31 14:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5026  13 59304 51579765 A  ERRORERROR'
2021-03-31 14:19:39 [DEBUG   ] Got command RPT from MCS: ref #5027
2021-03-31 14:19:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:19:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5027  77 59304 51579957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:19:40 [DEBUG   ] Got command RPT from MCS: ref #5028
2021-03-31 14:19:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5028  12 59304 51580161 A  ERRORB˜™š'
2021-03-31 14:19:51 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 14:20:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 14:20:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:20:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:20:22 [DEBUG   ] Finished updating board flags in 1.609 seconds
2021-03-31 14:20:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 14:20:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 14:21:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 14:21:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:21:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:21:22 [DEBUG   ] Finished updating board flags in 1.586 seconds
2021-03-31 14:21:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 14:21:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:22:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 14:22:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:22:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:22:22 [DEBUG   ] Finished updating board flags in 1.433 seconds
2021-03-31 14:22:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:22:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:23:11 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2021-03-31 14:23:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:23:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:23:22 [DEBUG   ] Finished updating board flags in 1.457 seconds
2021-03-31 14:23:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 14:23:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 14:24:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 14:24:20 [DEBUG   ] Got command RPT from MCS: ref #5040
2021-03-31 14:24:20 [DEBUG   ] summary = ERROR
2021-03-31 14:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5040  13 59304 51860237 A  ERRORERROR'
2021-03-31 14:24:20 [DEBUG   ] Got command RPT from MCS: ref #5041
2021-03-31 14:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5041  77 59304 51860237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:24:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:24:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:24:22 [DEBUG   ] Finished updating board flags in 1.318 seconds
2021-03-31 14:24:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 14:24:39 [DEBUG   ] Got command RPT from MCS: ref #5061
2021-03-31 14:24:39 [DEBUG   ] summary = ERROR
2021-03-31 14:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5061  13 59304 51879437 A  ERRORERROR'
2021-03-31 14:24:39 [DEBUG   ] Got command RPT from MCS: ref #5063
2021-03-31 14:24:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5063  77 59304 51879629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:24:39 [DEBUG   ] Got command RPT from MCS: ref #5065
2021-03-31 14:24:39 [DEBUG   ] summary = ERROR
2021-03-31 14:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5065  13 59304 51879833 A  ERRORERROR'
2021-03-31 14:24:40 [DEBUG   ] Got command RPT from MCS: ref #5066
2021-03-31 14:24:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:24:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5066  77 59304 51880037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:24:40 [DEBUG   ] Got command RPT from MCS: ref #5067
2021-03-31 14:24:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:24:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5067  12 59304 51880241 A  ERRORB—™š'
2021-03-31 14:24:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 14:25:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 14:25:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:25:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:25:22 [DEBUG   ] Finished updating board flags in 1.371 seconds
2021-03-31 14:25:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 14:25:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 14:26:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 14:26:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:26:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:26:23 [DEBUG   ] Finished updating board flags in 2.063 seconds
2021-03-31 14:26:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 14:26:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:27:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-03-31 14:27:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:27:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:27:23 [DEBUG   ] Finished updating board flags in 1.981 seconds
2021-03-31 14:27:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:27:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 14:28:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 14:28:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:28:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:28:23 [DEBUG   ] Finished updating board flags in 1.810 seconds
2021-03-31 14:28:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 14:28:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 14:29:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 14:29:20 [DEBUG   ] Got command RPT from MCS: ref #5074
2021-03-31 14:29:20 [DEBUG   ] summary = ERROR
2021-03-31 14:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5074  13 59304 52160245 A  ERRORERROR'
2021-03-31 14:29:20 [DEBUG   ] Got command RPT from MCS: ref #5075
2021-03-31 14:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5075  77 59304 52160245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:29:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:29:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:29:23 [DEBUG   ] Finished updating board flags in 1.809 seconds
2021-03-31 14:29:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 14:29:39 [DEBUG   ] Got command RPT from MCS: ref #5093
2021-03-31 14:29:39 [DEBUG   ] summary = ERROR
2021-03-31 14:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5093  13 59304 52179509 A  ERRORERROR'
2021-03-31 14:29:39 [DEBUG   ] Got command RPT from MCS: ref #5094
2021-03-31 14:29:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5094  77 59304 52179713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:29:39 [DEBUG   ] Got command RPT from MCS: ref #5095
2021-03-31 14:29:39 [DEBUG   ] summary = ERROR
2021-03-31 14:29:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5095  13 59304 52179905 A  ERRORERROR'
2021-03-31 14:29:40 [DEBUG   ] Got command RPT from MCS: ref #5096
2021-03-31 14:29:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:29:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5096  77 59304 52180109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:29:40 [DEBUG   ] Got command RPT from MCS: ref #5097
2021-03-31 14:29:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:29:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5097  12 59304 52180313 A  ERRORB˜™š'
2021-03-31 14:29:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:30:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 14:30:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:30:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:30:23 [DEBUG   ] Finished updating board flags in 1.779 seconds
2021-03-31 14:30:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:30:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 14:31:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 14:31:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:31:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:31:23 [DEBUG   ] Finished updating board flags in 1.625 seconds
2021-03-31 14:31:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:31:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:32:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 14:32:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:32:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:32:23 [DEBUG   ] Finished updating board flags in 1.594 seconds
2021-03-31 14:32:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:32:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 14:33:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 14:33:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:33:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:33:23 [DEBUG   ] Finished updating board flags in 1.425 seconds
2021-03-31 14:33:33 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 14:33:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 14:34:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 14:34:20 [DEBUG   ] Got command RPT from MCS: ref #5115
2021-03-31 14:34:20 [DEBUG   ] summary = ERROR
2021-03-31 14:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5115  13 59304 52460241 A  ERRORERROR'
2021-03-31 14:34:20 [DEBUG   ] Got command RPT from MCS: ref #5116
2021-03-31 14:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5116  77 59304 52460241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:34:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:34:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:34:23 [DEBUG   ] Finished updating board flags in 1.408 seconds
2021-03-31 14:34:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 14:34:39 [DEBUG   ] Got command RPT from MCS: ref #5132
2021-03-31 14:34:39 [DEBUG   ] summary = ERROR
2021-03-31 14:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5132  13 59304 52479577 A  ERRORERROR'
2021-03-31 14:34:39 [DEBUG   ] Got command RPT from MCS: ref #5133
2021-03-31 14:34:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5133  77 59304 52479781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:34:39 [DEBUG   ] Got command RPT from MCS: ref #5134
2021-03-31 14:34:39 [DEBUG   ] summary = ERROR
2021-03-31 14:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5134  13 59304 52479985 A  ERRORERROR'
2021-03-31 14:34:40 [DEBUG   ] Got command RPT from MCS: ref #5135
2021-03-31 14:34:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5135  77 59304 52480177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:34:40 [DEBUG   ] Got command RPT from MCS: ref #5136
2021-03-31 14:34:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5136  12 59304 52480381 A  ERRORB—™š'
2021-03-31 14:34:53 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-03-31 14:35:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 14:35:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:35:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:35:23 [DEBUG   ] Finished updating board flags in 1.365 seconds
2021-03-31 14:35:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 14:35:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:36:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:36:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:36:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:36:23 [DEBUG   ] Finished updating board flags in 1.375 seconds
2021-03-31 14:36:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:36:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 14:37:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 14:37:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:37:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:37:24 [DEBUG   ] Finished updating board flags in 2.036 seconds
2021-03-31 14:37:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:37:54 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2021-03-31 14:38:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 14:38:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:38:24 [DEBUG   ] Finished updating board flags in 2.010 seconds
2021-03-31 14:38:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:38:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:39:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 14:39:20 [DEBUG   ] Got command RPT from MCS: ref #5143
2021-03-31 14:39:20 [DEBUG   ] summary = ERROR
2021-03-31 14:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5143  13 59304 52760241 A  ERRORERROR'
2021-03-31 14:39:20 [DEBUG   ] Got command RPT from MCS: ref #5144
2021-03-31 14:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5144  77 59304 52760241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:39:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:39:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:39:24 [DEBUG   ] Finished updating board flags in 1.984 seconds
2021-03-31 14:39:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 14:39:39 [DEBUG   ] Got command RPT from MCS: ref #5166
2021-03-31 14:39:39 [DEBUG   ] summary = ERROR
2021-03-31 14:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5166  13 59304 52779657 A  ERRORERROR'
2021-03-31 14:39:39 [DEBUG   ] Got command RPT from MCS: ref #5168
2021-03-31 14:39:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:39:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5168  77 59304 52779861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:39:40 [DEBUG   ] Got command RPT from MCS: ref #5170
2021-03-31 14:39:40 [DEBUG   ] summary = ERROR
2021-03-31 14:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5170  13 59304 52780053 A  ERRORERROR'
2021-03-31 14:39:40 [DEBUG   ] Got command RPT from MCS: ref #5171
2021-03-31 14:39:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5171  77 59304 52780257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:39:40 [DEBUG   ] Got command RPT from MCS: ref #5172
2021-03-31 14:39:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5172  12 59304 52780461 A  ERRORB—™š'
2021-03-31 14:39:54 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-03-31 14:40:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 14:40:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:40:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:40:24 [DEBUG   ] Finished updating board flags in 1.808 seconds
2021-03-31 14:40:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 14:40:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-03-31 14:41:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 14:41:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:41:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:41:24 [DEBUG   ] Finished updating board flags in 1.803 seconds
2021-03-31 14:41:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 14:41:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 14:42:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:42:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:42:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:42:24 [DEBUG   ] Finished updating board flags in 1.789 seconds
2021-03-31 14:42:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:42:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:43:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:43:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:43:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:43:24 [DEBUG   ] Finished updating board flags in 1.694 seconds
2021-03-31 14:43:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 14:43:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 14:44:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:44:20 [DEBUG   ] Got command RPT from MCS: ref #5184
2021-03-31 14:44:20 [DEBUG   ] summary = ERROR
2021-03-31 14:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5184  13 59304 53060241 A  ERRORERROR'
2021-03-31 14:44:20 [DEBUG   ] Got command RPT from MCS: ref #5185
2021-03-31 14:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5185  77 59304 53060241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:44:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:44:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:44:24 [DEBUG   ] Finished updating board flags in 1.504 seconds
2021-03-31 14:44:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 14:44:39 [DEBUG   ] Got command RPT from MCS: ref #5201
2021-03-31 14:44:39 [DEBUG   ] summary = ERROR
2021-03-31 14:44:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5201  13 59304 53079729 A  ERRORERROR'
2021-03-31 14:44:39 [DEBUG   ] Got command RPT from MCS: ref #5202
2021-03-31 14:44:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:44:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5202  77 59304 53079933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:44:40 [DEBUG   ] Got command RPT from MCS: ref #5203
2021-03-31 14:44:40 [DEBUG   ] summary = ERROR
2021-03-31 14:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5203  13 59304 53080137 A  ERRORERROR'
2021-03-31 14:44:40 [DEBUG   ] Got command RPT from MCS: ref #5204
2021-03-31 14:44:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5204  77 59304 53080329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:44:40 [DEBUG   ] Got command RPT from MCS: ref #5205
2021-03-31 14:44:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5205  12 59304 53080533 A  ERRORB—™š'
2021-03-31 14:44:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 14:45:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:45:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:45:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:45:24 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 14:45:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:45:55 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2021-03-31 14:46:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:46:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:46:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:46:24 [DEBUG   ] Finished updating board flags in 1.414 seconds
2021-03-31 14:46:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:46:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 14:47:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 14:47:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:47:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:47:24 [DEBUG   ] Finished updating board flags in 1.412 seconds
2021-03-31 14:47:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 14:47:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 14:48:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 14:48:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:48:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:48:24 [DEBUG   ] Finished updating board flags in 1.412 seconds
2021-03-31 14:48:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 14:48:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 14:49:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 14:49:20 [DEBUG   ] Got command RPT from MCS: ref #5218
2021-03-31 14:49:20 [DEBUG   ] summary = ERROR
2021-03-31 14:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5218  13 59304 53360245 A  ERRORERROR'
2021-03-31 14:49:20 [DEBUG   ] Got command RPT from MCS: ref #5219
2021-03-31 14:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5219  77 59304 53360245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:49:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:49:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:49:24 [DEBUG   ] Finished updating board flags in 1.373 seconds
2021-03-31 14:49:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 14:49:39 [DEBUG   ] Got command RPT from MCS: ref #5237
2021-03-31 14:49:39 [DEBUG   ] summary = ERROR
2021-03-31 14:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5237  13 59304 53379805 A  ERRORERROR'
2021-03-31 14:49:39 [DEBUG   ] Got command RPT from MCS: ref #5238
2021-03-31 14:49:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5238  77 59304 53379997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:49:40 [DEBUG   ] Got command RPT from MCS: ref #5239
2021-03-31 14:49:40 [DEBUG   ] summary = ERROR
2021-03-31 14:49:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5239  13 59304 53380201 A  ERRORERROR'
2021-03-31 14:49:40 [DEBUG   ] Got command RPT from MCS: ref #5240
2021-03-31 14:49:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:49:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5240  77 59304 53380419 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:49:40 [DEBUG   ] Got command RPT from MCS: ref #5241
2021-03-31 14:49:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:49:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5241  12 59304 53380609 A  ERRORB—™š'
2021-03-31 14:49:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:50:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:50:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:50:24 [DEBUG   ] Finished updating board flags in 1.399 seconds
2021-03-31 14:50:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 14:50:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 14:51:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 14:51:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:51:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:51:25 [DEBUG   ] Finished updating board flags in 2.011 seconds
2021-03-31 14:51:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 14:51:56 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2021-03-31 14:52:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 14:52:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:52:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:52:25 [DEBUG   ] Finished updating board flags in 2.005 seconds
2021-03-31 14:52:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:52:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 14:53:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 14:53:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:53:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:53:25 [DEBUG   ] Finished updating board flags in 1.992 seconds
2021-03-31 14:53:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 14:53:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 14:54:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 14:54:20 [DEBUG   ] Got command RPT from MCS: ref #5253
2021-03-31 14:54:20 [DEBUG   ] summary = ERROR
2021-03-31 14:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5253  13 59304 53660249 A  ERRORERROR'
2021-03-31 14:54:20 [DEBUG   ] Got command RPT from MCS: ref #5254
2021-03-31 14:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5254  77 59304 53660249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:54:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:54:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:54:25 [DEBUG   ] Finished updating board flags in 1.803 seconds
2021-03-31 14:54:37 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2021-03-31 14:54:39 [DEBUG   ] Got command RPT from MCS: ref #5274
2021-03-31 14:54:39 [DEBUG   ] summary = ERROR
2021-03-31 14:54:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5274  13 59304 53679873 A  ERRORERROR'
2021-03-31 14:54:40 [DEBUG   ] Got command RPT from MCS: ref #5276
2021-03-31 14:54:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:54:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5276  77 59304 53680077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:54:40 [DEBUG   ] Got command RPT from MCS: ref #5278
2021-03-31 14:54:40 [DEBUG   ] summary = ERROR
2021-03-31 14:54:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5278  13 59304 53680281 A  ERRORERROR'
2021-03-31 14:54:40 [DEBUG   ] Got command RPT from MCS: ref #5279
2021-03-31 14:54:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:54:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5279  77 59304 53680473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:54:40 [DEBUG   ] Got command RPT from MCS: ref #5280
2021-03-31 14:54:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:54:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5280  12 59304 53680677 A  ERRORB˜™š'
2021-03-31 14:54:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 14:55:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 14:55:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:55:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:55:25 [DEBUG   ] Finished updating board flags in 1.803 seconds
2021-03-31 14:55:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 14:55:57 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 14:56:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 14:56:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:56:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:56:25 [DEBUG   ] Finished updating board flags in 1.895 seconds
2021-03-31 14:56:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 14:56:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 14:57:18 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 14:57:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:57:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-03-31 14:57:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:57:25 [DEBUG   ] Finished updating board flags in 1.708 seconds
2021-03-31 14:57:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 14:57:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 14:58:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 14:58:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:58:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:58:25 [DEBUG   ] Finished updating board flags in 1.607 seconds
2021-03-31 14:58:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 14:58:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2021-03-31 14:59:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 14:59:20 [DEBUG   ] Got command RPT from MCS: ref #5287
2021-03-31 14:59:20 [DEBUG   ] summary = ERROR
2021-03-31 14:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5287  13 59304 53960249 A  ERRORERROR'
2021-03-31 14:59:20 [DEBUG   ] Got command RPT from MCS: ref #5288
2021-03-31 14:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5288  77 59304 53960249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:59:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 14:59:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 14:59:25 [DEBUG   ] Finished updating board flags in 1.597 seconds
2021-03-31 14:59:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 14:59:39 [DEBUG   ] Got command RPT from MCS: ref #5306
2021-03-31 14:59:39 [DEBUG   ] summary = ERROR
2021-03-31 14:59:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5306  13 59304 53979953 A  ERRORERROR'
2021-03-31 14:59:40 [DEBUG   ] Got command RPT from MCS: ref #5307
2021-03-31 14:59:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:59:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5307  77 59304 53980145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:59:40 [DEBUG   ] Got command RPT from MCS: ref #5308
2021-03-31 14:59:40 [DEBUG   ] summary = ERROR
2021-03-31 14:59:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5308  13 59304 53980349 A  ERRORERROR'
2021-03-31 14:59:40 [DEBUG   ] Got command RPT from MCS: ref #5309
2021-03-31 14:59:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 14:59:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5309  77 59304 53980553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 14:59:40 [DEBUG   ] Got command RPT from MCS: ref #5310
2021-03-31 14:59:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 14:59:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5310  12 59304 53980745 A  ERRORB—™š'
2021-03-31 14:59:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:00:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:00:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:00:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:00:25 [DEBUG   ] Finished updating board flags in 1.412 seconds
2021-03-31 15:00:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-03-31 15:00:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 15:01:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:01:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:01:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:01:25 [DEBUG   ] Finished updating board flags in 1.402 seconds
2021-03-31 15:01:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 15:01:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 15:02:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 15:02:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:02:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:02:25 [DEBUG   ] Finished updating board flags in 1.402 seconds
2021-03-31 15:02:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 15:02:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 15:03:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:03:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2021-03-31 15:03:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:03:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:03:25 [DEBUG   ] Finished updating board flags in 1.397 seconds
2021-03-31 15:03:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 15:03:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 15:04:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 15:04:20 [DEBUG   ] Got command RPT from MCS: ref #5328
2021-03-31 15:04:20 [DEBUG   ] summary = ERROR
2021-03-31 15:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5328  13 59304 54260253 A  ERRORERROR'
2021-03-31 15:04:20 [DEBUG   ] Got command RPT from MCS: ref #5329
2021-03-31 15:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5329  77 59304 54260253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:04:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:04:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:04:25 [DEBUG   ] Finished updating board flags in 1.390 seconds
2021-03-31 15:04:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:04:40 [DEBUG   ] Got command RPT from MCS: ref #5345
2021-03-31 15:04:40 [DEBUG   ] summary = ERROR
2021-03-31 15:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5345  13 59304 54280021 A  ERRORERROR'
2021-03-31 15:04:40 [DEBUG   ] Got command RPT from MCS: ref #5346
2021-03-31 15:04:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5346  77 59304 54280225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:04:40 [DEBUG   ] Got command RPT from MCS: ref #5347
2021-03-31 15:04:40 [DEBUG   ] summary = ERROR
2021-03-31 15:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5347  13 59304 54280417 A  ERRORERROR'
2021-03-31 15:04:40 [DEBUG   ] Got command RPT from MCS: ref #5348
2021-03-31 15:04:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5348  77 59304 54280621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:04:40 [DEBUG   ] Got command RPT from MCS: ref #5349
2021-03-31 15:04:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5349  12 59304 54280825 A  ERRORB˜™š'
2021-03-31 15:04:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 15:05:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:05:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:05:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:05:26 [DEBUG   ] Finished updating board flags in 2.031 seconds
2021-03-31 15:05:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 15:05:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:06:19 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2021-03-31 15:06:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:06:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:06:26 [DEBUG   ] Finished updating board flags in 1.982 seconds
2021-03-31 15:06:40 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2021-03-31 15:07:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 15:07:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 15:07:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:07:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:07:26 [DEBUG   ] Finished updating board flags in 1.812 seconds
2021-03-31 15:07:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 15:08:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 15:08:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:08:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:08:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:08:26 [DEBUG   ] Finished updating board flags in 1.789 seconds
2021-03-31 15:08:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 15:09:00 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 15:09:20 [DEBUG   ] Got command RPT from MCS: ref #5356
2021-03-31 15:09:20 [DEBUG   ] summary = ERROR
2021-03-31 15:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5356  13 59304 54560253 A  ERRORERROR'
2021-03-31 15:09:20 [DEBUG   ] Got command RPT from MCS: ref #5357
2021-03-31 15:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5357  77 59304 54560253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:09:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 15:09:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:09:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:09:26 [DEBUG   ] Finished updating board flags in 1.635 seconds
2021-03-31 15:09:40 [DEBUG   ] Got command RPT from MCS: ref #5379
2021-03-31 15:09:40 [DEBUG   ] summary = ERROR
2021-03-31 15:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5379  13 59304 54580093 A  ERRORERROR'
2021-03-31 15:09:40 [DEBUG   ] Got command RPT from MCS: ref #5381
2021-03-31 15:09:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5381  77 59304 54580297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:09:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:09:40 [DEBUG   ] Got command RPT from MCS: ref #5383
2021-03-31 15:09:40 [DEBUG   ] summary = ERROR
2021-03-31 15:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5383  13 59304 54580501 A  ERRORERROR'
2021-03-31 15:09:40 [DEBUG   ] Got command RPT from MCS: ref #5384
2021-03-31 15:09:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5384  77 59304 54580693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:09:40 [DEBUG   ] Got command RPT from MCS: ref #5385
2021-03-31 15:09:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5385  12 59304 54580897 A  ERRORB—™š'
2021-03-31 15:10:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 15:10:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:10:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:10:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:10:26 [DEBUG   ] Finished updating board flags in 1.574 seconds
2021-03-31 15:10:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 15:11:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:11:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 15:11:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:11:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:11:26 [DEBUG   ] Finished updating board flags in 1.414 seconds
2021-03-31 15:11:40 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2021-03-31 15:12:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 15:12:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 15:12:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:12:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:12:26 [DEBUG   ] Finished updating board flags in 1.390 seconds
2021-03-31 15:12:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 15:13:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 15:13:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 15:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:13:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:13:26 [DEBUG   ] Finished updating board flags in 1.368 seconds
2021-03-31 15:13:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 15:14:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 15:14:20 [DEBUG   ] Got command RPT from MCS: ref #5397
2021-03-31 15:14:20 [DEBUG   ] summary = ERROR
2021-03-31 15:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5397  13 59304 54860257 A  ERRORERROR'
2021-03-31 15:14:20 [DEBUG   ] Got command RPT from MCS: ref #5398
2021-03-31 15:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5398  77 59304 54860257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:14:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 15:14:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:14:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:14:27 [DEBUG   ] Finished updating board flags in 2.052 seconds
2021-03-31 15:14:40 [DEBUG   ] Got command RPT from MCS: ref #5414
2021-03-31 15:14:40 [DEBUG   ] summary = ERROR
2021-03-31 15:14:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5414  13 59304 54880165 A  ERRORERROR'
2021-03-31 15:14:40 [DEBUG   ] Got command RPT from MCS: ref #5415
2021-03-31 15:14:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:14:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5415  77 59304 54880369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:14:40 [DEBUG   ] Got command RPT from MCS: ref #5416
2021-03-31 15:14:40 [DEBUG   ] summary = ERROR
2021-03-31 15:14:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5416  13 59304 54880573 A  ERRORERROR'
2021-03-31 15:14:40 [DEBUG   ] Got command RPT from MCS: ref #5417
2021-03-31 15:14:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:14:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5417  77 59304 54880765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:14:40 [DEBUG   ] Got command RPT from MCS: ref #5418
2021-03-31 15:14:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:14:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5418  12 59304 54880969 A  ERRORB˜™š'
2021-03-31 15:14:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 15:15:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2021-03-31 15:15:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 15:15:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:15:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:15:27 [DEBUG   ] Finished updating board flags in 1.983 seconds
2021-03-31 15:15:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 15:16:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:16:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 15:16:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:16:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:16:27 [DEBUG   ] Finished updating board flags in 1.810 seconds
2021-03-31 15:16:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:17:01 [DEBUG   ] Finished updating ant stats in 0.671 seconds
2021-03-31 15:17:21 [DEBUG   ] Finished updating ant stats in 0.530 seconds
2021-03-31 15:17:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:17:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:17:27 [DEBUG   ] Finished updating board flags in 1.808 seconds
2021-03-31 15:17:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 15:18:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 15:18:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 15:18:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:18:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:18:27 [DEBUG   ] Finished updating board flags in 1.794 seconds
2021-03-31 15:18:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 15:19:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 15:19:20 [DEBUG   ] Got command RPT from MCS: ref #5431
2021-03-31 15:19:20 [DEBUG   ] summary = ERROR
2021-03-31 15:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5431  13 59304 55160249 A  ERRORERROR'
2021-03-31 15:19:20 [DEBUG   ] Got command RPT from MCS: ref #5432
2021-03-31 15:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5432  77 59304 55160249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:19:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:19:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:19:27 [DEBUG   ] Finished updating board flags in 1.777 seconds
2021-03-31 15:19:40 [DEBUG   ] Got command RPT from MCS: ref #5450
2021-03-31 15:19:40 [DEBUG   ] summary = ERROR
2021-03-31 15:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5450  13 59304 55180245 A  ERRORERROR'
2021-03-31 15:19:40 [DEBUG   ] Got command RPT from MCS: ref #5451
2021-03-31 15:19:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5451  77 59304 55180449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:19:40 [DEBUG   ] Got command RPT from MCS: ref #5452
2021-03-31 15:19:40 [DEBUG   ] summary = ERROR
2021-03-31 15:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5452  13 59304 55180641 A  ERRORERROR'
2021-03-31 15:19:40 [DEBUG   ] Got command RPT from MCS: ref #5453
2021-03-31 15:19:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:19:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5453  77 59304 55180845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:19:41 [DEBUG   ] Got command RPT from MCS: ref #5454
2021-03-31 15:19:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:19:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5454  12 59304 55181049 A  ERRORB—™š'
2021-03-31 15:19:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:20:02 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2021-03-31 15:20:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 15:20:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:20:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:20:27 [DEBUG   ] Finished updating board flags in 1.422 seconds
2021-03-31 15:20:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:21:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:21:23 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2021-03-31 15:21:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:21:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:21:27 [DEBUG   ] Finished updating board flags in 1.409 seconds
2021-03-31 15:21:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:22:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-03-31 15:22:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:22:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:22:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:22:27 [DEBUG   ] Finished updating board flags in 1.419 seconds
2021-03-31 15:22:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:23:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 15:23:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:23:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:23:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:23:27 [DEBUG   ] Finished updating board flags in 1.435 seconds
2021-03-31 15:23:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:24:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 15:24:20 [DEBUG   ] Got command RPT from MCS: ref #5466
2021-03-31 15:24:20 [DEBUG   ] summary = ERROR
2021-03-31 15:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5466  13 59304 55460249 A  ERRORERROR'
2021-03-31 15:24:20 [DEBUG   ] Got command RPT from MCS: ref #5467
2021-03-31 15:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5467  77 59304 55460249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:24:23 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2021-03-31 15:24:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:24:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:24:27 [DEBUG   ] Finished updating board flags in 1.421 seconds
2021-03-31 15:24:40 [DEBUG   ] Got command RPT from MCS: ref #5487
2021-03-31 15:24:40 [DEBUG   ] summary = ERROR
2021-03-31 15:24:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5487  13 59304 55480313 A  ERRORERROR'
2021-03-31 15:24:40 [DEBUG   ] Got command RPT from MCS: ref #5489
2021-03-31 15:24:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:24:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5489  77 59304 55480517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:24:40 [DEBUG   ] Got command RPT from MCS: ref #5491
2021-03-31 15:24:40 [DEBUG   ] summary = ERROR
2021-03-31 15:24:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5491  13 59304 55480721 A  ERRORERROR'
2021-03-31 15:24:40 [DEBUG   ] Got command RPT from MCS: ref #5492
2021-03-31 15:24:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:24:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5492  77 59304 55480913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:24:41 [DEBUG   ] Got command RPT from MCS: ref #5493
2021-03-31 15:24:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5493  12 59304 55481117 A  ERRORB˜™š'
2021-03-31 15:24:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 15:25:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 15:25:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 15:25:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:25:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:25:27 [DEBUG   ] Finished updating board flags in 1.416 seconds
2021-03-31 15:25:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:26:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 15:26:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:26:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:26:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:26:27 [DEBUG   ] Finished updating board flags in 1.410 seconds
2021-03-31 15:26:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-03-31 15:27:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:27:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:27:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:27:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:27:27 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 15:27:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 15:28:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 15:28:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 15:28:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:28:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:28:27 [DEBUG   ] Finished updating board flags in 1.410 seconds
2021-03-31 15:28:44 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2021-03-31 15:29:04 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2021-03-31 15:29:20 [DEBUG   ] Got command RPT from MCS: ref #5500
2021-03-31 15:29:20 [DEBUG   ] summary = ERROR
2021-03-31 15:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5500  13 59304 55760249 A  ERRORERROR'
2021-03-31 15:29:20 [DEBUG   ] Got command RPT from MCS: ref #5501
2021-03-31 15:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5501  77 59304 55760249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:29:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:29:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:29:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:29:27 [DEBUG   ] Finished updating board flags in 1.454 seconds
2021-03-31 15:29:40 [DEBUG   ] Got command RPT from MCS: ref #5519
2021-03-31 15:29:40 [DEBUG   ] summary = ERROR
2021-03-31 15:29:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5519  13 59304 55780385 A  ERRORERROR'
2021-03-31 15:29:40 [DEBUG   ] Got command RPT from MCS: ref #5520
2021-03-31 15:29:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:29:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5520  77 59304 55780589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:29:40 [DEBUG   ] Got command RPT from MCS: ref #5521
2021-03-31 15:29:40 [DEBUG   ] summary = ERROR
2021-03-31 15:29:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5521  13 59304 55780793 A  ERRORERROR'
2021-03-31 15:29:40 [DEBUG   ] Got command RPT from MCS: ref #5522
2021-03-31 15:29:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:29:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5522  77 59304 55780985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:29:41 [DEBUG   ] Got command RPT from MCS: ref #5523
2021-03-31 15:29:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5523  12 59304 55781189 A  ERRORB—™š'
2021-03-31 15:29:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:30:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 15:30:24 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2021-03-31 15:30:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:30:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:30:27 [DEBUG   ] Finished updating board flags in 1.417 seconds
2021-03-31 15:30:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:31:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 15:31:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:31:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:31:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:31:27 [DEBUG   ] Finished updating board flags in 1.433 seconds
2021-03-31 15:31:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 15:32:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:32:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:32:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:32:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:32:28 [DEBUG   ] Finished updating board flags in 2.306 seconds
2021-03-31 15:32:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:33:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 15:33:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:33:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:33:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:33:28 [DEBUG   ] Finished updating board flags in 2.228 seconds
2021-03-31 15:33:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 15:34:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:34:20 [DEBUG   ] Got command RPT from MCS: ref #5541
2021-03-31 15:34:20 [DEBUG   ] summary = ERROR
2021-03-31 15:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5541  13 59304 56060253 A  ERRORERROR'
2021-03-31 15:34:20 [DEBUG   ] Got command RPT from MCS: ref #5542
2021-03-31 15:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5542  77 59304 56060253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:34:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 15:34:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:34:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:34:28 [DEBUG   ] Finished updating board flags in 2.058 seconds
2021-03-31 15:34:40 [DEBUG   ] Got command RPT from MCS: ref #5558
2021-03-31 15:34:40 [DEBUG   ] summary = ERROR
2021-03-31 15:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5558  13 59304 56080457 A  ERRORERROR'
2021-03-31 15:34:40 [DEBUG   ] Got command RPT from MCS: ref #5559
2021-03-31 15:34:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5559  77 59304 56080661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:34:40 [DEBUG   ] Got command RPT from MCS: ref #5560
2021-03-31 15:34:40 [DEBUG   ] summary = ERROR
2021-03-31 15:34:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5560  13 59304 56080865 A  ERRORERROR'
2021-03-31 15:34:41 [DEBUG   ] Got command RPT from MCS: ref #5561
2021-03-31 15:34:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:34:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5561  77 59304 56081057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:34:41 [DEBUG   ] Got command RPT from MCS: ref #5562
2021-03-31 15:34:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:34:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5562  12 59304 56081261 A  ERRORB—™š'
2021-03-31 15:34:45 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 15:35:05 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2021-03-31 15:35:25 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-03-31 15:35:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:35:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:35:28 [DEBUG   ] Finished updating board flags in 2.023 seconds
2021-03-31 15:35:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:36:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 15:36:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 15:36:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:36:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:36:28 [DEBUG   ] Finished updating board flags in 1.984 seconds
2021-03-31 15:36:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 15:37:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:37:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 15:37:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:37:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:37:28 [DEBUG   ] Finished updating board flags in 1.810 seconds
2021-03-31 15:37:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:38:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 15:38:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:38:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:38:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:38:28 [DEBUG   ] Finished updating board flags in 1.784 seconds
2021-03-31 15:38:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:39:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:39:20 [DEBUG   ] Got command RPT from MCS: ref #5569
2021-03-31 15:39:20 [DEBUG   ] summary = ERROR
2021-03-31 15:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5569  13 59304 56360253 A  ERRORERROR'
2021-03-31 15:39:20 [DEBUG   ] Got command RPT from MCS: ref #5570
2021-03-31 15:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5570  77 59304 56360253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:39:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 15:39:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:39:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:39:28 [DEBUG   ] Finished updating board flags in 1.623 seconds
2021-03-31 15:39:40 [DEBUG   ] Got command RPT from MCS: ref #5592
2021-03-31 15:39:40 [DEBUG   ] summary = ERROR
2021-03-31 15:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5592  13 59304 56380533 A  ERRORERROR'
2021-03-31 15:39:40 [DEBUG   ] Got command RPT from MCS: ref #5594
2021-03-31 15:39:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5594  77 59304 56380737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:39:40 [DEBUG   ] Got command RPT from MCS: ref #5596
2021-03-31 15:39:40 [DEBUG   ] summary = ERROR
2021-03-31 15:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5596  13 59304 56380941 A  ERRORERROR'
2021-03-31 15:39:41 [DEBUG   ] Got command RPT from MCS: ref #5597
2021-03-31 15:39:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:39:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5597  77 59304 56381133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:39:41 [DEBUG   ] Got command RPT from MCS: ref #5598
2021-03-31 15:39:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:39:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5598  12 59304 56381337 A  ERRORB˜™š'
2021-03-31 15:39:46 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2021-03-31 15:40:06 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 15:40:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 15:40:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:40:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:40:28 [DEBUG   ] Finished updating board flags in 1.582 seconds
2021-03-31 15:40:46 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 15:41:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 15:41:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 15:41:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:41:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:41:28 [DEBUG   ] Finished updating board flags in 1.413 seconds
2021-03-31 15:41:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 15:42:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:42:26 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2021-03-31 15:42:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:42:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:42:28 [DEBUG   ] Finished updating board flags in 1.388 seconds
2021-03-31 15:42:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 15:43:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:43:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:43:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:43:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2021-03-31 15:43:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:43:28 [DEBUG   ] Finished updating board flags in 1.359 seconds
2021-03-31 15:43:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:44:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 15:44:20 [DEBUG   ] Got command RPT from MCS: ref #5610
2021-03-31 15:44:20 [DEBUG   ] summary = ERROR
2021-03-31 15:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5610  13 59304 56660253 A  ERRORERROR'
2021-03-31 15:44:20 [DEBUG   ] Got command RPT from MCS: ref #5611
2021-03-31 15:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5611  77 59304 56660253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:44:27 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 15:44:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:44:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:44:29 [DEBUG   ] Finished updating board flags in 2.056 seconds
2021-03-31 15:44:40 [DEBUG   ] Got command RPT from MCS: ref #5627
2021-03-31 15:44:40 [DEBUG   ] summary = ERROR
2021-03-31 15:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5627  13 59304 56680609 A  ERRORERROR'
2021-03-31 15:44:40 [DEBUG   ] Got command RPT from MCS: ref #5628
2021-03-31 15:44:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5628  77 59304 56680813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:44:41 [DEBUG   ] Got command RPT from MCS: ref #5629
2021-03-31 15:44:41 [DEBUG   ] summary = ERROR
2021-03-31 15:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5629  13 59304 56681005 A  ERRORERROR'
2021-03-31 15:44:41 [DEBUG   ] Got command RPT from MCS: ref #5630
2021-03-31 15:44:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5630  77 59304 56681209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:44:41 [DEBUG   ] Got command RPT from MCS: ref #5631
2021-03-31 15:44:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5631  12 59304 56681413 A  ERRORB—™š'
2021-03-31 15:44:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 15:45:07 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 15:45:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 15:45:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:45:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:45:29 [DEBUG   ] Finished updating board flags in 2.007 seconds
2021-03-31 15:45:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 15:46:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 15:46:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 15:46:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:46:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:46:29 [DEBUG   ] Finished updating board flags in 1.999 seconds
2021-03-31 15:46:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:47:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 15:47:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 15:47:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:47:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:47:29 [DEBUG   ] Finished updating board flags in 1.813 seconds
2021-03-31 15:47:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 15:48:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:48:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 15:48:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:48:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:48:29 [DEBUG   ] Finished updating board flags in 1.780 seconds
2021-03-31 15:48:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-03-31 15:49:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 15:49:20 [DEBUG   ] Got command RPT from MCS: ref #5644
2021-03-31 15:49:20 [DEBUG   ] summary = ERROR
2021-03-31 15:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5644  13 59304 56960261 A  ERRORERROR'
2021-03-31 15:49:20 [DEBUG   ] Got command RPT from MCS: ref #5645
2021-03-31 15:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5645  77 59304 56960261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:49:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:49:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:49:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:49:29 [DEBUG   ] Finished updating board flags in 1.612 seconds
2021-03-31 15:49:40 [DEBUG   ] Got command RPT from MCS: ref #5663
2021-03-31 15:49:40 [DEBUG   ] summary = ERROR
2021-03-31 15:49:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5663  13 59304 56980677 A  ERRORERROR'
2021-03-31 15:49:40 [DEBUG   ] Got command RPT from MCS: ref #5664
2021-03-31 15:49:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:49:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5664  77 59304 56980881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:49:41 [DEBUG   ] Got command RPT from MCS: ref #5665
2021-03-31 15:49:41 [DEBUG   ] summary = ERROR
2021-03-31 15:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5665  13 59304 56981085 A  ERRORERROR'
2021-03-31 15:49:41 [DEBUG   ] Got command RPT from MCS: ref #5666
2021-03-31 15:49:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5666  77 59304 56981277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:49:41 [DEBUG   ] Got command RPT from MCS: ref #5667
2021-03-31 15:49:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5667  12 59304 56981481 A  ERRORB˜™š'
2021-03-31 15:49:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:50:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 15:50:27 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2021-03-31 15:50:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:50:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:50:29 [DEBUG   ] Finished updating board flags in 1.591 seconds
2021-03-31 15:50:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 15:51:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 15:51:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 15:51:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:51:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:51:29 [DEBUG   ] Finished updating board flags in 1.423 seconds
2021-03-31 15:51:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 15:52:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 15:52:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 15:52:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:52:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:52:29 [DEBUG   ] Finished updating board flags in 1.475 seconds
2021-03-31 15:52:47 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 15:53:08 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2021-03-31 15:53:28 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 15:53:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:53:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:53:29 [DEBUG   ] Finished updating board flags in 1.467 seconds
2021-03-31 15:53:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 15:54:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 15:54:20 [DEBUG   ] Got command RPT from MCS: ref #5679
2021-03-31 15:54:20 [DEBUG   ] summary = ERROR
2021-03-31 15:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5679  13 59304 57260261 A  ERRORERROR'
2021-03-31 15:54:20 [DEBUG   ] Got command RPT from MCS: ref #5680
2021-03-31 15:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5680  77 59304 57260261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:54:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 15:54:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:54:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:54:29 [DEBUG   ] Finished updating board flags in 1.471 seconds
2021-03-31 15:54:40 [DEBUG   ] Got command RPT from MCS: ref #5700
2021-03-31 15:54:40 [DEBUG   ] summary = ERROR
2021-03-31 15:54:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5700  13 59304 57280753 A  ERRORERROR'
2021-03-31 15:54:40 [DEBUG   ] Got command RPT from MCS: ref #5702
2021-03-31 15:54:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:54:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5702  77 59304 57280957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:54:41 [DEBUG   ] Got command RPT from MCS: ref #5704
2021-03-31 15:54:41 [DEBUG   ] summary = ERROR
2021-03-31 15:54:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5704  13 59304 57281161 A  ERRORERROR'
2021-03-31 15:54:41 [DEBUG   ] Got command RPT from MCS: ref #5705
2021-03-31 15:54:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:54:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5705  77 59304 57281353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:54:41 [DEBUG   ] Got command RPT from MCS: ref #5706
2021-03-31 15:54:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:54:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5706  12 59304 57281557 A  ERRORB—™š'
2021-03-31 15:54:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 15:55:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2021-03-31 15:55:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 15:55:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:55:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:55:30 [DEBUG   ] Finished updating board flags in 2.274 seconds
2021-03-31 15:55:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:56:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 15:56:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 15:56:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:56:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:56:30 [DEBUG   ] Finished updating board flags in 2.113 seconds
2021-03-31 15:56:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 15:57:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 15:57:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 15:57:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:57:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:57:30 [DEBUG   ] Finished updating board flags in 2.006 seconds
2021-03-31 15:57:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 15:58:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 15:58:29 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2021-03-31 15:58:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:58:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:58:30 [DEBUG   ] Finished updating board flags in 1.988 seconds
2021-03-31 15:58:49 [DEBUG   ] Finished updating ant stats in 1.153 seconds
2021-03-31 15:59:09 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-03-31 15:59:20 [DEBUG   ] Got command RPT from MCS: ref #5713
2021-03-31 15:59:20 [DEBUG   ] summary = ERROR
2021-03-31 15:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5713  13 59304 57560261 A  ERRORERROR'
2021-03-31 15:59:20 [DEBUG   ] Got command RPT from MCS: ref #5714
2021-03-31 15:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5714  77 59304 57560261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:59:29 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2021-03-31 15:59:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 15:59:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 15:59:30 [DEBUG   ] Finished updating board flags in 1.818 seconds
2021-03-31 15:59:40 [DEBUG   ] Got command RPT from MCS: ref #5732
2021-03-31 15:59:40 [DEBUG   ] summary = ERROR
2021-03-31 15:59:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5732  13 59304 57580825 A  ERRORERROR'
2021-03-31 15:59:41 [DEBUG   ] Got command RPT from MCS: ref #5733
2021-03-31 15:59:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5733  77 59304 57581029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:59:41 [DEBUG   ] Got command RPT from MCS: ref #5734
2021-03-31 15:59:41 [DEBUG   ] summary = ERROR
2021-03-31 15:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5734  13 59304 57581221 A  ERRORERROR'
2021-03-31 15:59:41 [DEBUG   ] Got command RPT from MCS: ref #5735
2021-03-31 15:59:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 15:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5735  77 59304 57581425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 15:59:41 [DEBUG   ] Got command RPT from MCS: ref #5736
2021-03-31 15:59:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 15:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5736  12 59304 57581629 A  ERRORB˜™š'
2021-03-31 15:59:49 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2021-03-31 16:00:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 16:00:29 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2021-03-31 16:00:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:00:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:00:30 [DEBUG   ] Finished updating board flags in 1.808 seconds
2021-03-31 16:00:49 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2021-03-31 16:01:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 16:01:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:01:30 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2021-03-31 16:01:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:01:30 [DEBUG   ] Finished updating board flags in 1.836 seconds
2021-03-31 16:01:50 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2021-03-31 16:02:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:02:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:02:30 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2021-03-31 16:02:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:02:30 [DEBUG   ] Finished updating board flags in 1.820 seconds
2021-03-31 16:02:50 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2021-03-31 16:03:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:03:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:03:30 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2021-03-31 16:03:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:03:30 [DEBUG   ] Finished updating board flags in 1.786 seconds
2021-03-31 16:03:50 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2021-03-31 16:04:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 16:04:20 [DEBUG   ] Got command RPT from MCS: ref #5754
2021-03-31 16:04:20 [DEBUG   ] summary = ERROR
2021-03-31 16:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5754  13 59304 57860257 A  ERRORERROR'
2021-03-31 16:04:20 [DEBUG   ] Got command RPT from MCS: ref #5755
2021-03-31 16:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5755  77 59304 57860257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:04:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:04:30 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2021-03-31 16:04:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:04:30 [DEBUG   ] Finished updating board flags in 1.630 seconds
2021-03-31 16:04:40 [DEBUG   ] Got command RPT from MCS: ref #5771
2021-03-31 16:04:40 [DEBUG   ] summary = ERROR
2021-03-31 16:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5771  13 59304 57880901 A  ERRORERROR'
2021-03-31 16:04:41 [DEBUG   ] Got command RPT from MCS: ref #5772
2021-03-31 16:04:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5772  77 59304 57881093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:04:41 [DEBUG   ] Got command RPT from MCS: ref #5773
2021-03-31 16:04:41 [DEBUG   ] summary = ERROR
2021-03-31 16:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5773  13 59304 57881297 A  ERRORERROR'
2021-03-31 16:04:41 [DEBUG   ] Got command RPT from MCS: ref #5774
2021-03-31 16:04:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5774  77 59304 57881501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:04:41 [DEBUG   ] Got command RPT from MCS: ref #5775
2021-03-31 16:04:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5775  12 59304 57881693 A  ERRORB˜™š'
2021-03-31 16:04:50 [DEBUG   ] Finished updating ant stats in 0.561 seconds
2021-03-31 16:05:10 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-03-31 16:05:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:05:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:05:30 [DEBUG   ] Finished updating board flags in 1.561 seconds
2021-03-31 16:05:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 16:05:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 16:06:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 16:06:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:06:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:06:30 [DEBUG   ] Finished updating board flags in 1.458 seconds
2021-03-31 16:06:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 16:06:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 16:07:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 16:07:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:07:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 16:07:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:07:31 [DEBUG   ] Finished updating board flags in 2.576 seconds
2021-03-31 16:07:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 16:08:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 16:08:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:08:31 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2021-03-31 16:08:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:08:31 [DEBUG   ] Finished updating board flags in 2.194 seconds
2021-03-31 16:08:51 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2021-03-31 16:09:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 16:09:20 [DEBUG   ] Got command RPT from MCS: ref #5782
2021-03-31 16:09:20 [DEBUG   ] summary = ERROR
2021-03-31 16:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5782  13 59304 58160265 A  ERRORERROR'
2021-03-31 16:09:20 [DEBUG   ] Got command RPT from MCS: ref #5783
2021-03-31 16:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5783  77 59304 58160265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:09:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:09:31 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2021-03-31 16:09:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:09:31 [DEBUG   ] Finished updating board flags in 2.017 seconds
2021-03-31 16:09:40 [DEBUG   ] Got command RPT from MCS: ref #5805
2021-03-31 16:09:40 [DEBUG   ] summary = ERROR
2021-03-31 16:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5805  13 59304 58180965 A  ERRORERROR'
2021-03-31 16:09:41 [DEBUG   ] Got command RPT from MCS: ref #5807
2021-03-31 16:09:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5807  77 59304 58181169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:09:41 [DEBUG   ] Got command RPT from MCS: ref #5809
2021-03-31 16:09:41 [DEBUG   ] summary = ERROR
2021-03-31 16:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5809  13 59304 58181373 A  ERRORERROR'
2021-03-31 16:09:41 [DEBUG   ] Got command RPT from MCS: ref #5810
2021-03-31 16:09:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5810  77 59304 58181565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:09:41 [DEBUG   ] Got command RPT from MCS: ref #5811
2021-03-31 16:09:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5811  12 59304 58181769 A  ERRORB—™š'
2021-03-31 16:09:51 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2021-03-31 16:10:12 [DEBUG   ] Finished updating ant stats in 1.386 seconds
2021-03-31 16:10:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:10:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:10:31 [DEBUG   ] Finished updating board flags in 1.974 seconds
2021-03-31 16:10:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 16:10:52 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 16:11:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 16:11:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:11:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:11:31 [DEBUG   ] Finished updating board flags in 1.808 seconds
2021-03-31 16:11:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 16:11:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 16:12:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 16:12:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:12:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:12:31 [DEBUG   ] Finished updating board flags in 1.893 seconds
2021-03-31 16:12:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-03-31 16:12:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 16:13:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 16:13:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 16:13:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:13:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:13:31 [DEBUG   ] Finished updating board flags in 1.680 seconds
2021-03-31 16:13:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 16:13:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 16:14:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 16:14:20 [DEBUG   ] Got command RPT from MCS: ref #5823
2021-03-31 16:14:20 [DEBUG   ] summary = ERROR
2021-03-31 16:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5823  13 59304 58460261 A  ERRORERROR'
2021-03-31 16:14:20 [DEBUG   ] Got command RPT from MCS: ref #5824
2021-03-31 16:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5824  77 59304 58460261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:14:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:14:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:14:31 [DEBUG   ] Finished updating board flags in 1.591 seconds
2021-03-31 16:14:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 16:14:41 [DEBUG   ] Got command RPT from MCS: ref #5840
2021-03-31 16:14:41 [DEBUG   ] summary = ERROR
2021-03-31 16:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5840  13 59304 58481033 A  ERRORERROR'
2021-03-31 16:14:41 [DEBUG   ] Got command RPT from MCS: ref #5841
2021-03-31 16:14:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5841  77 59304 58481237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:14:41 [DEBUG   ] Got command RPT from MCS: ref #5842
2021-03-31 16:14:41 [DEBUG   ] summary = ERROR
2021-03-31 16:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5842  13 59304 58481441 A  ERRORERROR'
2021-03-31 16:14:41 [DEBUG   ] Got command RPT from MCS: ref #5843
2021-03-31 16:14:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5843  77 59304 58481645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:14:41 [DEBUG   ] Got command RPT from MCS: ref #5844
2021-03-31 16:14:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5844  12 59304 58481838 A  ERRORB˜™š'
2021-03-31 16:14:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 16:15:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 16:15:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:15:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:15:31 [DEBUG   ] Finished updating board flags in 1.414 seconds
2021-03-31 16:15:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 16:15:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 16:16:13 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 16:16:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:16:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:16:31 [DEBUG   ] Finished updating board flags in 1.424 seconds
2021-03-31 16:16:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 16:16:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 16:17:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:17:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:17:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:17:31 [DEBUG   ] Finished updating board flags in 1.431 seconds
2021-03-31 16:17:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 16:17:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:18:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 16:18:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:18:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:18:31 [DEBUG   ] Finished updating board flags in 1.424 seconds
2021-03-31 16:18:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 16:18:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 16:19:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 16:19:20 [DEBUG   ] Got command RPT from MCS: ref #5857
2021-03-31 16:19:20 [DEBUG   ] summary = ERROR
2021-03-31 16:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5857  13 59304 58760261 A  ERRORERROR'
2021-03-31 16:19:20 [DEBUG   ] Got command RPT from MCS: ref #5858
2021-03-31 16:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5858  77 59304 58760261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:19:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:19:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:19:31 [DEBUG   ] Finished updating board flags in 1.427 seconds
2021-03-31 16:19:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 16:19:41 [DEBUG   ] Got command RPT from MCS: ref #5876
2021-03-31 16:19:41 [DEBUG   ] summary = ERROR
2021-03-31 16:19:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5876  13 59304 58781109 A  ERRORERROR'
2021-03-31 16:19:41 [DEBUG   ] Got command RPT from MCS: ref #5877
2021-03-31 16:19:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:19:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5877  77 59304 58781313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:19:41 [DEBUG   ] Got command RPT from MCS: ref #5878
2021-03-31 16:19:41 [DEBUG   ] summary = ERROR
2021-03-31 16:19:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5878  13 59304 58781517 A  ERRORERROR'
2021-03-31 16:19:41 [DEBUG   ] Got command RPT from MCS: ref #5879
2021-03-31 16:19:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:19:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5879  77 59304 58781709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:19:41 [DEBUG   ] Got command RPT from MCS: ref #5880
2021-03-31 16:19:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:19:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5880  12 59304 58781913 A  ERRORB˜™š'
2021-03-31 16:19:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 16:20:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 16:20:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:20:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:20:32 [DEBUG   ] Finished updating board flags in 1.703 seconds
2021-03-31 16:20:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 16:20:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 16:21:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 16:21:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:21:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:21:32 [DEBUG   ] Finished updating board flags in 2.218 seconds
2021-03-31 16:21:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 16:21:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 16:22:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 16:22:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:22:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:22:32 [DEBUG   ] Finished updating board flags in 2.182 seconds
2021-03-31 16:22:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 16:22:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 16:23:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:23:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:23:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:23:32 [DEBUG   ] Finished updating board flags in 1.998 seconds
2021-03-31 16:23:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 16:23:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:24:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:24:20 [DEBUG   ] Got command RPT from MCS: ref #5892
2021-03-31 16:24:20 [DEBUG   ] summary = ERROR
2021-03-31 16:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5892  13 59304 59060273 A  ERRORERROR'
2021-03-31 16:24:20 [DEBUG   ] Got command RPT from MCS: ref #5893
2021-03-31 16:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5893  77 59304 59060273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:24:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:24:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:24:32 [DEBUG   ] Finished updating board flags in 1.809 seconds
2021-03-31 16:24:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 16:24:41 [DEBUG   ] Got command RPT from MCS: ref #5913
2021-03-31 16:24:41 [DEBUG   ] summary = ERROR
2021-03-31 16:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5913  13 59304 59081185 A  ERRORERROR'
2021-03-31 16:24:41 [DEBUG   ] Got command RPT from MCS: ref #5915
2021-03-31 16:24:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5915  77 59304 59081389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:24:41 [DEBUG   ] Got command RPT from MCS: ref #5917
2021-03-31 16:24:41 [DEBUG   ] summary = ERROR
2021-03-31 16:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5917  13 59304 59081581 A  ERRORERROR'
2021-03-31 16:24:41 [DEBUG   ] Got command RPT from MCS: ref #5918
2021-03-31 16:24:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5918  77 59304 59081785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:24:41 [DEBUG   ] Got command RPT from MCS: ref #5919
2021-03-31 16:24:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:24:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5919  12 59304 59081989 A  ERRORB—™š'
2021-03-31 16:24:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 16:25:14 [DEBUG   ] Finished updating ant stats in 0.586 seconds
2021-03-31 16:25:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:25:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:25:32 [DEBUG   ] Finished updating board flags in 1.778 seconds
2021-03-31 16:25:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 16:25:54 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2021-03-31 16:26:15 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-03-31 16:26:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:26:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-03-31 16:26:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:26:32 [DEBUG   ] Finished updating board flags in 1.613 seconds
2021-03-31 16:26:35 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 16:26:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 16:27:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 16:27:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:27:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:27:32 [DEBUG   ] Finished updating board flags in 1.588 seconds
2021-03-31 16:27:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 16:27:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:28:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 16:28:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:28:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:28:32 [DEBUG   ] Finished updating board flags in 1.416 seconds
2021-03-31 16:28:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:28:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 16:29:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 16:29:20 [DEBUG   ] Got command RPT from MCS: ref #5926
2021-03-31 16:29:20 [DEBUG   ] summary = ERROR
2021-03-31 16:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5926  13 59304 59360273 A  ERRORERROR'
2021-03-31 16:29:20 [DEBUG   ] Got command RPT from MCS: ref #5927
2021-03-31 16:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5927  77 59304 59360273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:29:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:29:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:29:32 [DEBUG   ] Finished updating board flags in 1.424 seconds
2021-03-31 16:29:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:29:41 [DEBUG   ] Got command RPT from MCS: ref #5945
2021-03-31 16:29:41 [DEBUG   ] summary = ERROR
2021-03-31 16:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5945  13 59304 59381253 A  ERRORERROR'
2021-03-31 16:29:41 [DEBUG   ] Got command RPT from MCS: ref #5946
2021-03-31 16:29:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5946  77 59304 59381457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:29:41 [DEBUG   ] Got command RPT from MCS: ref #5947
2021-03-31 16:29:41 [DEBUG   ] summary = ERROR
2021-03-31 16:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5947  13 59304 59381661 A  ERRORERROR'
2021-03-31 16:29:41 [DEBUG   ] Got command RPT from MCS: ref #5948
2021-03-31 16:29:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:29:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5948  77 59304 59381853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:29:42 [DEBUG   ] Got command RPT from MCS: ref #5949
2021-03-31 16:29:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:29:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5949  12 59304 59382057 A  ERRORB—™š'
2021-03-31 16:29:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 16:30:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 16:30:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:30:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:30:32 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 16:30:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 16:30:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 16:31:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 16:31:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:31:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:31:32 [DEBUG   ] Finished updating board flags in 1.362 seconds
2021-03-31 16:31:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 16:31:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 16:32:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 16:32:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:32:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:32:32 [DEBUG   ] Finished updating board flags in 1.363 seconds
2021-03-31 16:32:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 16:32:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 16:33:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 16:33:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:33:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:33:33 [DEBUG   ] Finished updating board flags in 2.056 seconds
2021-03-31 16:33:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 16:33:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 16:34:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:34:20 [DEBUG   ] Got command RPT from MCS: ref #5967
2021-03-31 16:34:20 [DEBUG   ] summary = ERROR
2021-03-31 16:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5967  13 59304 59660273 A  ERRORERROR'
2021-03-31 16:34:20 [DEBUG   ] Got command RPT from MCS: ref #5968
2021-03-31 16:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5968  77 59304 59660273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:34:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:34:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:34:33 [DEBUG   ] Finished updating board flags in 1.989 seconds
2021-03-31 16:34:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 16:34:41 [DEBUG   ] Got command RPT from MCS: ref #5984
2021-03-31 16:34:41 [DEBUG   ] summary = ERROR
2021-03-31 16:34:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5984  13 59304 59681325 A  ERRORERROR'
2021-03-31 16:34:41 [DEBUG   ] Got command RPT from MCS: ref #5985
2021-03-31 16:34:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:34:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5985  77 59304 59681529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:34:41 [DEBUG   ] Got command RPT from MCS: ref #5986
2021-03-31 16:34:41 [DEBUG   ] summary = ERROR
2021-03-31 16:34:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5986  13 59304 59681733 A  ERRORERROR'
2021-03-31 16:34:41 [DEBUG   ] Got command RPT from MCS: ref #5987
2021-03-31 16:34:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:34:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5987  77 59304 59681925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:34:42 [DEBUG   ] Got command RPT from MCS: ref #5988
2021-03-31 16:34:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:34:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5988  12 59304 59682129 A  ERRORB˜™š'
2021-03-31 16:34:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 16:35:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:35:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:35:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:35:33 [DEBUG   ] Finished updating board flags in 1.885 seconds
2021-03-31 16:35:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:35:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 16:36:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 16:36:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:36:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:36:33 [DEBUG   ] Finished updating board flags in 1.714 seconds
2021-03-31 16:36:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:36:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:37:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 16:37:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:37:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:37:33 [DEBUG   ] Finished updating board flags in 1.621 seconds
2021-03-31 16:37:36 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2021-03-31 16:37:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 16:38:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 16:38:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:38:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:38:33 [DEBUG   ] Finished updating board flags in 1.577 seconds
2021-03-31 16:38:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 16:38:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 16:39:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 16:39:20 [DEBUG   ] Got command RPT from MCS: ref #5995
2021-03-31 16:39:20 [DEBUG   ] summary = ERROR
2021-03-31 16:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5995  13 59304 59960277 A  ERRORERROR'
2021-03-31 16:39:20 [DEBUG   ] Got command RPT from MCS: ref #5996
2021-03-31 16:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5996  77 59304 59960277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:39:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:39:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:39:33 [DEBUG   ] Finished updating board flags in 1.416 seconds
2021-03-31 16:39:37 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2021-03-31 16:39:41 [DEBUG   ] Got command RPT from MCS: ref #6018
2021-03-31 16:39:41 [DEBUG   ] summary = ERROR
2021-03-31 16:39:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6018  13 59304 59981405 A  ERRORERROR'
2021-03-31 16:39:41 [DEBUG   ] Got command RPT from MCS: ref #6020
2021-03-31 16:39:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:39:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6020  77 59304 59981597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:39:41 [DEBUG   ] Got command RPT from MCS: ref #6022
2021-03-31 16:39:41 [DEBUG   ] summary = ERROR
2021-03-31 16:39:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6022  13 59304 59981801 A  ERRORERROR'
2021-03-31 16:39:42 [DEBUG   ] Got command RPT from MCS: ref #6023
2021-03-31 16:39:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6023  77 59304 59982005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:39:42 [DEBUG   ] Got command RPT from MCS: ref #6024
2021-03-31 16:39:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6024  12 59304 59982197 A  ERRORB—™š'
2021-03-31 16:39:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 16:40:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 16:40:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:40:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:40:33 [DEBUG   ] Finished updating board flags in 1.411 seconds
2021-03-31 16:40:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 16:40:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 16:41:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 16:41:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:41:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:41:33 [DEBUG   ] Finished updating board flags in 1.462 seconds
2021-03-31 16:41:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 16:41:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 16:42:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:42:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:42:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:42:33 [DEBUG   ] Finished updating board flags in 1.459 seconds
2021-03-31 16:42:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 16:42:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 16:43:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 16:43:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-03-31 16:43:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:43:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:43:33 [DEBUG   ] Finished updating board flags in 1.461 seconds
2021-03-31 16:43:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 16:43:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:44:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:44:20 [DEBUG   ] Got command RPT from MCS: ref #6036
2021-03-31 16:44:20 [DEBUG   ] summary = ERROR
2021-03-31 16:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6036  13 59304 60260277 A  ERRORERROR'
2021-03-31 16:44:20 [DEBUG   ] Got command RPT from MCS: ref #6037
2021-03-31 16:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6037  77 59304 60260277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:44:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:44:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:44:33 [DEBUG   ] Finished updating board flags in 1.479 seconds
2021-03-31 16:44:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 16:44:41 [DEBUG   ] Got command RPT from MCS: ref #6053
2021-03-31 16:44:41 [DEBUG   ] summary = ERROR
2021-03-31 16:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6053  13 59304 60281473 A  ERRORERROR'
2021-03-31 16:44:41 [DEBUG   ] Got command RPT from MCS: ref #6054
2021-03-31 16:44:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6054  77 59304 60281677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:44:41 [DEBUG   ] Got command RPT from MCS: ref #6055
2021-03-31 16:44:41 [DEBUG   ] summary = ERROR
2021-03-31 16:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6055  13 59304 60281881 A  ERRORERROR'
2021-03-31 16:44:42 [DEBUG   ] Got command RPT from MCS: ref #6056
2021-03-31 16:44:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6056  77 59304 60282073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:44:42 [DEBUG   ] Got command RPT from MCS: ref #6057
2021-03-31 16:44:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6057  12 59304 60282277 A  ERRORB˜™š'
2021-03-31 16:44:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 16:45:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 16:45:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:45:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:45:34 [DEBUG   ] Finished updating board flags in 2.218 seconds
2021-03-31 16:45:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 16:45:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 16:46:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 16:46:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:46:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:46:34 [DEBUG   ] Finished updating board flags in 2.110 seconds
2021-03-31 16:46:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 16:46:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 16:47:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 16:47:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:47:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:47:34 [DEBUG   ] Finished updating board flags in 2.016 seconds
2021-03-31 16:47:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 16:47:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 16:48:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 16:48:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:48:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:48:34 [DEBUG   ] Finished updating board flags in 1.999 seconds
2021-03-31 16:48:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 16:48:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 16:49:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:49:20 [DEBUG   ] Got command RPT from MCS: ref #6070
2021-03-31 16:49:20 [DEBUG   ] summary = ERROR
2021-03-31 16:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6070  13 59304 60560273 A  ERRORERROR'
2021-03-31 16:49:20 [DEBUG   ] Got command RPT from MCS: ref #6071
2021-03-31 16:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6071  77 59304 60560273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:49:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:49:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:49:34 [DEBUG   ] Finished updating board flags in 1.805 seconds
2021-03-31 16:49:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:49:41 [DEBUG   ] Got command RPT from MCS: ref #6089
2021-03-31 16:49:41 [DEBUG   ] summary = ERROR
2021-03-31 16:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6089  13 59304 60581553 A  ERRORERROR'
2021-03-31 16:49:41 [DEBUG   ] Got command RPT from MCS: ref #6090
2021-03-31 16:49:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6090  77 59304 60581745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:49:41 [DEBUG   ] Got command RPT from MCS: ref #6091
2021-03-31 16:49:41 [DEBUG   ] summary = ERROR
2021-03-31 16:49:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6091  13 59304 60581949 A  ERRORERROR'
2021-03-31 16:49:42 [DEBUG   ] Got command RPT from MCS: ref #6092
2021-03-31 16:49:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:49:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6092  77 59304 60582153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:49:42 [DEBUG   ] Got command RPT from MCS: ref #6093
2021-03-31 16:49:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:49:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6093  12 59304 60582345 A  ERRORB˜™š'
2021-03-31 16:49:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 16:50:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 16:50:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:50:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:50:34 [DEBUG   ] Finished updating board flags in 1.817 seconds
2021-03-31 16:50:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 16:50:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2021-03-31 16:51:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 16:51:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:51:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:51:34 [DEBUG   ] Finished updating board flags in 1.820 seconds
2021-03-31 16:51:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:51:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:52:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 16:52:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:52:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:52:34 [DEBUG   ] Finished updating board flags in 1.757 seconds
2021-03-31 16:52:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 16:52:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 16:53:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 16:53:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:53:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:53:34 [DEBUG   ] Finished updating board flags in 1.615 seconds
2021-03-31 16:53:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 16:53:59 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 16:54:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 16:54:20 [DEBUG   ] Got command RPT from MCS: ref #6105
2021-03-31 16:54:20 [DEBUG   ] summary = ERROR
2021-03-31 16:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6105  13 59304 60860269 A  ERRORERROR'
2021-03-31 16:54:20 [DEBUG   ] Got command RPT from MCS: ref #6106
2021-03-31 16:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6106  77 59304 60860269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:54:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:54:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:54:34 [DEBUG   ] Finished updating board flags in 1.599 seconds
2021-03-31 16:54:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 16:54:41 [DEBUG   ] Got command RPT from MCS: ref #6126
2021-03-31 16:54:41 [DEBUG   ] summary = ERROR
2021-03-31 16:54:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6126  13 59304 60881625 A  ERRORERROR'
2021-03-31 16:54:41 [DEBUG   ] Got command RPT from MCS: ref #6128
2021-03-31 16:54:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:54:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6128  77 59304 60881817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:54:42 [DEBUG   ] Got command RPT from MCS: ref #6130
2021-03-31 16:54:42 [DEBUG   ] summary = ERROR
2021-03-31 16:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6130  13 59304 60882021 A  ERRORERROR'
2021-03-31 16:54:42 [DEBUG   ] Got command RPT from MCS: ref #6131
2021-03-31 16:54:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6131  77 59304 60882225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:54:42 [DEBUG   ] Got command RPT from MCS: ref #6132
2021-03-31 16:54:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6132  12 59304 60882417 A  ERRORB—™š'
2021-03-31 16:54:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 16:55:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 16:55:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-03-31 16:55:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:55:34 [DEBUG   ] Finished updating board flags in 1.408 seconds
2021-03-31 16:55:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:55:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 16:56:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 16:56:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:56:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:56:34 [DEBUG   ] Finished updating board flags in 1.440 seconds
2021-03-31 16:56:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:56:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 16:57:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 16:57:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2021-03-31 16:57:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:57:34 [DEBUG   ] Finished updating board flags in 1.363 seconds
2021-03-31 16:57:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 16:57:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 16:58:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 16:58:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:58:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-03-31 16:58:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:58:34 [DEBUG   ] Finished updating board flags in 1.372 seconds
2021-03-31 16:58:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 16:58:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 16:59:20 [DEBUG   ] Got command RPT from MCS: ref #6139
2021-03-31 16:59:20 [DEBUG   ] summary = ERROR
2021-03-31 16:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6139  13 59304 61160281 A  ERRORERROR'
2021-03-31 16:59:20 [DEBUG   ] Got command RPT from MCS: ref #6140
2021-03-31 16:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6140  77 59304 61160281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:59:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 16:59:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 16:59:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 16:59:35 [DEBUG   ] Finished updating board flags in 2.041 seconds
2021-03-31 16:59:40 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 16:59:41 [DEBUG   ] Got command RPT from MCS: ref #6158
2021-03-31 16:59:41 [DEBUG   ] summary = ERROR
2021-03-31 16:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6158  13 59304 61181689 A  ERRORERROR'
2021-03-31 16:59:41 [DEBUG   ] Got command RPT from MCS: ref #6159
2021-03-31 16:59:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6159  77 59304 61181893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:59:42 [DEBUG   ] Got command RPT from MCS: ref #6160
2021-03-31 16:59:42 [DEBUG   ] summary = ERROR
2021-03-31 16:59:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6160  13 59304 61182097 A  ERRORERROR'
2021-03-31 16:59:42 [DEBUG   ] Got command RPT from MCS: ref #6161
2021-03-31 16:59:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 16:59:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6161  77 59304 61182289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 16:59:42 [DEBUG   ] Got command RPT from MCS: ref #6162
2021-03-31 16:59:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 16:59:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6162  12 59304 61182493 A  ERRORB–™š'
2021-03-31 17:00:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 17:00:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 17:00:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:00:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:00:35 [DEBUG   ] Finished updating board flags in 1.989 seconds
2021-03-31 17:00:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 17:01:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 17:01:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 17:01:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:01:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:01:35 [DEBUG   ] Finished updating board flags in 1.800 seconds
2021-03-31 17:01:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:02:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 17:02:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 17:02:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:02:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:02:35 [DEBUG   ] Finished updating board flags in 1.855 seconds
2021-03-31 17:02:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 17:03:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:03:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:03:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:03:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:03:35 [DEBUG   ] Finished updating board flags in 1.752 seconds
2021-03-31 17:03:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 17:04:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 17:04:20 [DEBUG   ] Got command RPT from MCS: ref #6180
2021-03-31 17:04:20 [DEBUG   ] summary = ERROR
2021-03-31 17:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6180  13 59304 61460281 A  ERRORERROR'
2021-03-31 17:04:20 [DEBUG   ] Got command RPT from MCS: ref #6181
2021-03-31 17:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6181  77 59304 61460281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:04:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:04:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:04:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:04:35 [DEBUG   ] Finished updating board flags in 1.643 seconds
2021-03-31 17:04:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 17:04:41 [DEBUG   ] Got command RPT from MCS: ref #6197
2021-03-31 17:04:41 [DEBUG   ] summary = ERROR
2021-03-31 17:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6197  13 59304 61481765 A  ERRORERROR'
2021-03-31 17:04:41 [DEBUG   ] Got command RPT from MCS: ref #6198
2021-03-31 17:04:41 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6198  77 59304 61481969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:04:42 [DEBUG   ] Got command RPT from MCS: ref #6199
2021-03-31 17:04:42 [DEBUG   ] summary = ERROR
2021-03-31 17:04:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6199  13 59304 61482161 A  ERRORERROR'
2021-03-31 17:04:42 [DEBUG   ] Got command RPT from MCS: ref #6200
2021-03-31 17:04:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:04:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6200  77 59304 61482365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:04:42 [DEBUG   ] Got command RPT from MCS: ref #6201
2021-03-31 17:04:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:04:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6201  12 59304 61482569 A  ERRORB˜™š'
2021-03-31 17:05:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 17:05:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 17:05:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:05:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:05:35 [DEBUG   ] Finished updating board flags in 1.561 seconds
2021-03-31 17:05:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 17:06:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 17:06:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 17:06:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:06:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:06:35 [DEBUG   ] Finished updating board flags in 1.437 seconds
2021-03-31 17:06:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 17:07:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 17:07:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 17:07:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:07:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:07:35 [DEBUG   ] Finished updating board flags in 1.434 seconds
2021-03-31 17:07:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 17:08:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 17:08:21 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 17:08:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:08:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:08:35 [DEBUG   ] Finished updating board flags in 1.433 seconds
2021-03-31 17:08:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 17:09:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 17:09:20 [DEBUG   ] Got command RPT from MCS: ref #6208
2021-03-31 17:09:20 [DEBUG   ] summary = ERROR
2021-03-31 17:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6208  13 59304 61760277 A  ERRORERROR'
2021-03-31 17:09:20 [DEBUG   ] Got command RPT from MCS: ref #6209
2021-03-31 17:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6209  77 59304 61760277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:09:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:09:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:09:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:09:35 [DEBUG   ] Finished updating board flags in 1.433 seconds
2021-03-31 17:09:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 17:09:41 [DEBUG   ] Got command RPT from MCS: ref #6231
2021-03-31 17:09:41 [DEBUG   ] summary = ERROR
2021-03-31 17:09:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6231  13 59304 61781833 A  ERRORERROR'
2021-03-31 17:09:42 [DEBUG   ] Got command RPT from MCS: ref #6233
2021-03-31 17:09:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6233  77 59304 61782037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:09:42 [DEBUG   ] Got command RPT from MCS: ref #6235
2021-03-31 17:09:42 [DEBUG   ] summary = ERROR
2021-03-31 17:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6235  13 59304 61782241 A  ERRORERROR'
2021-03-31 17:09:42 [DEBUG   ] Got command RPT from MCS: ref #6236
2021-03-31 17:09:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6236  77 59304 61782433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:09:42 [DEBUG   ] Got command RPT from MCS: ref #6237
2021-03-31 17:09:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6237  12 59304 61782637 A  ERRORB—™š'
2021-03-31 17:10:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2021-03-31 17:10:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 17:10:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:10:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:10:35 [DEBUG   ] Finished updating board flags in 1.444 seconds
2021-03-31 17:10:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 17:11:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 17:11:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 17:11:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:11:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:11:35 [DEBUG   ] Finished updating board flags in 1.452 seconds
2021-03-31 17:11:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:12:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 17:12:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 17:12:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:12:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:12:36 [DEBUG   ] Finished updating board flags in 2.230 seconds
2021-03-31 17:12:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 17:13:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 17:13:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 17:13:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-03-31 17:13:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:13:36 [DEBUG   ] Finished updating board flags in 2.138 seconds
2021-03-31 17:13:42 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2021-03-31 17:14:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:14:20 [DEBUG   ] Got command RPT from MCS: ref #6249
2021-03-31 17:14:20 [DEBUG   ] summary = ERROR
2021-03-31 17:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6249  13 59304 62060281 A  ERRORERROR'
2021-03-31 17:14:20 [DEBUG   ] Got command RPT from MCS: ref #6250
2021-03-31 17:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6250  77 59304 62060281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:14:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:14:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2021-03-31 17:14:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:14:36 [DEBUG   ] Finished updating board flags in 2.059 seconds
2021-03-31 17:14:41 [DEBUG   ] Got command RPT from MCS: ref #6266
2021-03-31 17:14:41 [DEBUG   ] summary = ERROR
2021-03-31 17:14:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6266  13 59304 62081913 A  ERRORERROR'
2021-03-31 17:14:42 [DEBUG   ] Got command RPT from MCS: ref #6267
2021-03-31 17:14:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:14:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6267  77 59304 62082117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:14:42 [DEBUG   ] Got command RPT from MCS: ref #6268
2021-03-31 17:14:42 [DEBUG   ] summary = ERROR
2021-03-31 17:14:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6268  13 59304 62082309 A  ERRORERROR'
2021-03-31 17:14:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 17:14:42 [DEBUG   ] Got command RPT from MCS: ref #6269
2021-03-31 17:14:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:14:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6269  77 59304 62082513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:14:42 [DEBUG   ] Got command RPT from MCS: ref #6270
2021-03-31 17:14:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:14:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6270  12 59304 62082717 A  ERRORB–™š'
2021-03-31 17:15:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 17:15:22 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2021-03-31 17:15:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:15:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:15:36 [DEBUG   ] Finished updating board flags in 1.953 seconds
2021-03-31 17:15:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:16:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 17:16:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:16:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:16:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:16:36 [DEBUG   ] Finished updating board flags in 1.812 seconds
2021-03-31 17:16:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:17:03 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2021-03-31 17:17:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 17:17:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:17:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:17:36 [DEBUG   ] Finished updating board flags in 1.811 seconds
2021-03-31 17:17:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 17:18:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:18:23 [DEBUG   ] Finished updating ant stats in 1.605 seconds
2021-03-31 17:18:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:18:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:18:36 [DEBUG   ] Finished updating board flags in 1.782 seconds
2021-03-31 17:18:42 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2021-03-31 17:19:03 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-03-31 17:19:20 [DEBUG   ] Got command RPT from MCS: ref #6283
2021-03-31 17:19:20 [DEBUG   ] summary = ERROR
2021-03-31 17:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6283  13 59304 62360281 A  ERRORERROR'
2021-03-31 17:19:20 [DEBUG   ] Got command RPT from MCS: ref #6284
2021-03-31 17:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6284  77 59304 62360281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:19:23 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 17:19:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 17:19:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:19:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:19:36 [DEBUG   ] Finished updating board flags in 1.615 seconds
2021-03-31 17:19:41 [DEBUG   ] Got command RPT from MCS: ref #6302
2021-03-31 17:19:41 [DEBUG   ] summary = ERROR
2021-03-31 17:19:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6302  13 59304 62381981 A  ERRORERROR'
2021-03-31 17:19:42 [DEBUG   ] Got command RPT from MCS: ref #6303
2021-03-31 17:19:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:19:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6303  77 59304 62382185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:19:42 [DEBUG   ] Got command RPT from MCS: ref #6304
2021-03-31 17:19:42 [DEBUG   ] summary = ERROR
2021-03-31 17:19:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6304  13 59304 62382389 A  ERRORERROR'
2021-03-31 17:19:42 [DEBUG   ] Got command RPT from MCS: ref #6305
2021-03-31 17:19:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:19:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6305  77 59304 62382581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:19:42 [DEBUG   ] Got command RPT from MCS: ref #6306
2021-03-31 17:19:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:19:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6306  12 59304 62382785 A  ERRORB˜™š'
2021-03-31 17:19:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 17:20:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 17:20:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 17:20:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:20:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:20:36 [DEBUG   ] Finished updating board flags in 1.623 seconds
2021-03-31 17:20:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 17:21:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 17:21:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 17:21:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:21:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:21:36 [DEBUG   ] Finished updating board flags in 1.571 seconds
2021-03-31 17:21:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:22:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:22:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 17:22:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:22:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:22:36 [DEBUG   ] Finished updating board flags in 1.413 seconds
2021-03-31 17:22:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:23:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:23:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:23:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:23:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:23:36 [DEBUG   ] Finished updating board flags in 1.485 seconds
2021-03-31 17:23:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 17:24:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 17:24:20 [DEBUG   ] Got command RPT from MCS: ref #6318
2021-03-31 17:24:20 [DEBUG   ] summary = ERROR
2021-03-31 17:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6318  13 59304 62660281 A  ERRORERROR'
2021-03-31 17:24:20 [DEBUG   ] Got command RPT from MCS: ref #6319
2021-03-31 17:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6319  77 59304 62660281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:24:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:24:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:24:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:24:37 [DEBUG   ] Finished updating board flags in 1.694 seconds
2021-03-31 17:24:42 [DEBUG   ] Got command RPT from MCS: ref #6339
2021-03-31 17:24:42 [DEBUG   ] summary = ERROR
2021-03-31 17:24:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6339  13 59304 62682053 A  ERRORERROR'
2021-03-31 17:24:42 [DEBUG   ] Got command RPT from MCS: ref #6341
2021-03-31 17:24:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:24:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6341  77 59304 62682257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:24:42 [DEBUG   ] Got command RPT from MCS: ref #6343
2021-03-31 17:24:42 [DEBUG   ] summary = ERROR
2021-03-31 17:24:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6343  13 59304 62682461 A  ERRORERROR'
2021-03-31 17:24:42 [DEBUG   ] Got command RPT from MCS: ref #6344
2021-03-31 17:24:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:24:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6344  77 59304 62682653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:24:42 [DEBUG   ] Got command RPT from MCS: ref #6345
2021-03-31 17:24:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:24:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6345  12 59304 62682857 A  ERRORB˜™š'
2021-03-31 17:24:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 17:25:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 17:25:24 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2021-03-31 17:25:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:25:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:25:36 [DEBUG   ] Finished updating board flags in 1.458 seconds
2021-03-31 17:25:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 17:26:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 17:26:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 17:26:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:26:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:26:37 [DEBUG   ] Finished updating board flags in 2.168 seconds
2021-03-31 17:26:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 17:27:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 17:27:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 17:27:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:27:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:27:37 [DEBUG   ] Finished updating board flags in 1.984 seconds
2021-03-31 17:27:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 17:28:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:28:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:28:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:28:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:28:37 [DEBUG   ] Finished updating board flags in 1.812 seconds
2021-03-31 17:28:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 17:29:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 17:29:20 [DEBUG   ] Got command RPT from MCS: ref #6352
2021-03-31 17:29:20 [DEBUG   ] summary = ERROR
2021-03-31 17:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6352  13 59304 62960277 A  ERRORERROR'
2021-03-31 17:29:20 [DEBUG   ] Got command RPT from MCS: ref #6353
2021-03-31 17:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6353  77 59304 62960277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:29:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:29:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:29:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:29:37 [DEBUG   ] Finished updating board flags in 1.788 seconds
2021-03-31 17:29:42 [DEBUG   ] Got command RPT from MCS: ref #6371
2021-03-31 17:29:42 [DEBUG   ] summary = ERROR
2021-03-31 17:29:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6371  13 59304 62982129 A  ERRORERROR'
2021-03-31 17:29:42 [DEBUG   ] Got command RPT from MCS: ref #6372
2021-03-31 17:29:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:29:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6372  77 59304 62982333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:29:42 [DEBUG   ] Got command RPT from MCS: ref #6373
2021-03-31 17:29:42 [DEBUG   ] summary = ERROR
2021-03-31 17:29:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6373  13 59304 62982525 A  ERRORERROR'
2021-03-31 17:29:42 [DEBUG   ] Got command RPT from MCS: ref #6374
2021-03-31 17:29:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:29:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6374  77 59304 62982729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:29:42 [DEBUG   ] Got command RPT from MCS: ref #6375
2021-03-31 17:29:42 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:29:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6375  12 59304 62982933 A  ERRORB—™š'
2021-03-31 17:29:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 17:30:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 17:30:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:30:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:30:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:30:37 [DEBUG   ] Finished updating board flags in 1.711 seconds
2021-03-31 17:30:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:31:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 17:31:24 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-03-31 17:31:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:31:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:31:37 [DEBUG   ] Finished updating board flags in 1.507 seconds
2021-03-31 17:31:45 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-03-31 17:32:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 17:32:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 17:32:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:32:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:32:37 [DEBUG   ] Finished updating board flags in 1.408 seconds
2021-03-31 17:32:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 17:33:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 17:33:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 17:33:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:33:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:33:37 [DEBUG   ] Finished updating board flags in 1.412 seconds
2021-03-31 17:33:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 17:34:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 17:34:20 [DEBUG   ] Got command RPT from MCS: ref #6393
2021-03-31 17:34:20 [DEBUG   ] summary = ERROR
2021-03-31 17:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6393  13 59304 63260281 A  ERRORERROR'
2021-03-31 17:34:20 [DEBUG   ] Got command RPT from MCS: ref #6394
2021-03-31 17:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6394  77 59304 63260281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:34:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:34:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:34:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:34:37 [DEBUG   ] Finished updating board flags in 1.389 seconds
2021-03-31 17:34:42 [DEBUG   ] Got command RPT from MCS: ref #6410
2021-03-31 17:34:42 [DEBUG   ] summary = ERROR
2021-03-31 17:34:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6410  13 59304 63282201 A  ERRORERROR'
2021-03-31 17:34:42 [DEBUG   ] Got command RPT from MCS: ref #6411
2021-03-31 17:34:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:34:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6411  77 59304 63282405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:34:42 [DEBUG   ] Got command RPT from MCS: ref #6412
2021-03-31 17:34:42 [DEBUG   ] summary = ERROR
2021-03-31 17:34:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6412  13 59304 63282609 A  ERRORERROR'
2021-03-31 17:34:42 [DEBUG   ] Got command RPT from MCS: ref #6413
2021-03-31 17:34:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:34:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6413  77 59304 63282801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:34:43 [DEBUG   ] Got command RPT from MCS: ref #6414
2021-03-31 17:34:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:34:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6414  12 59304 63283005 A  ERRORB–™š'
2021-03-31 17:34:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:35:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 17:35:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 17:35:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:35:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:35:37 [DEBUG   ] Finished updating board flags in 1.348 seconds
2021-03-31 17:35:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 17:36:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:36:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:36:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:36:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:36:38 [DEBUG   ] Finished updating board flags in 2.056 seconds
2021-03-31 17:36:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 17:37:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 17:37:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 17:37:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:37:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:37:38 [DEBUG   ] Finished updating board flags in 1.991 seconds
2021-03-31 17:37:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 17:38:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 17:38:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 17:38:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:38:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:38:38 [DEBUG   ] Finished updating board flags in 1.834 seconds
2021-03-31 17:38:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:39:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 17:39:20 [DEBUG   ] Got command RPT from MCS: ref #6431
2021-03-31 17:39:20 [DEBUG   ] summary = ERROR
2021-03-31 17:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6431  13 59304 63560281 A  ERRORERROR'
2021-03-31 17:39:20 [DEBUG   ] Got command RPT from MCS: ref #6432
2021-03-31 17:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6432  77 59304 63560281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:39:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 17:39:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:39:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:39:38 [DEBUG   ] Finished updating board flags in 1.778 seconds
2021-03-31 17:39:42 [DEBUG   ] Got command RPT from MCS: ref #6454
2021-03-31 17:39:42 [DEBUG   ] summary = ERROR
2021-03-31 17:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6454  13 59304 63582277 A  ERRORERROR'
2021-03-31 17:39:42 [DEBUG   ] Got command RPT from MCS: ref #6456
2021-03-31 17:39:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6456  77 59304 63582481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:39:42 [DEBUG   ] Got command RPT from MCS: ref #6458
2021-03-31 17:39:42 [DEBUG   ] summary = ERROR
2021-03-31 17:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6458  13 59304 63582673 A  ERRORERROR'
2021-03-31 17:39:42 [DEBUG   ] Got command RPT from MCS: ref #6459
2021-03-31 17:39:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6459  77 59304 63582877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:39:43 [DEBUG   ] Got command RPT from MCS: ref #6460
2021-03-31 17:39:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:39:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6460  12 59304 63583081 A  ERRORB˜™š'
2021-03-31 17:39:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 17:40:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 17:40:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:40:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:40:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:40:38 [DEBUG   ] Finished updating board flags in 1.602 seconds
2021-03-31 17:40:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:41:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 17:41:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 17:41:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:41:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:41:38 [DEBUG   ] Finished updating board flags in 1.616 seconds
2021-03-31 17:41:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 17:42:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 17:42:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 17:42:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:42:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:42:38 [DEBUG   ] Finished updating board flags in 1.589 seconds
2021-03-31 17:42:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 17:43:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 17:43:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 17:43:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:43:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:43:38 [DEBUG   ] Finished updating board flags in 1.413 seconds
2021-03-31 17:43:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:44:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:44:20 [DEBUG   ] Got command RPT from MCS: ref #6472
2021-03-31 17:44:20 [DEBUG   ] summary = ERROR
2021-03-31 17:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6472  13 59304 63860281 A  ERRORERROR'
2021-03-31 17:44:20 [DEBUG   ] Got command RPT from MCS: ref #6473
2021-03-31 17:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6473  77 59304 63860281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:44:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 17:44:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:44:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:44:38 [DEBUG   ] Finished updating board flags in 1.380 seconds
2021-03-31 17:44:42 [DEBUG   ] Got command RPT from MCS: ref #6489
2021-03-31 17:44:42 [DEBUG   ] summary = ERROR
2021-03-31 17:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6489  13 59304 63882353 A  ERRORERROR'
2021-03-31 17:44:42 [DEBUG   ] Got command RPT from MCS: ref #6490
2021-03-31 17:44:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6490  77 59304 63882545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:44:42 [DEBUG   ] Got command RPT from MCS: ref #6491
2021-03-31 17:44:42 [DEBUG   ] summary = ERROR
2021-03-31 17:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6491  13 59304 63882749 A  ERRORERROR'
2021-03-31 17:44:42 [DEBUG   ] Got command RPT from MCS: ref #6492
2021-03-31 17:44:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:44:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6492  77 59304 63882953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:44:43 [DEBUG   ] Got command RPT from MCS: ref #6493
2021-03-31 17:44:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:44:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6493  12 59304 63883145 A  ERRORB˜™š'
2021-03-31 17:44:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 17:45:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 17:45:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:45:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:45:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:45:38 [DEBUG   ] Finished updating board flags in 1.385 seconds
2021-03-31 17:45:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:46:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 17:46:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 17:46:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:46:39 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:46:39 [DEBUG   ] Finished updating board flags in 2.118 seconds
2021-03-31 17:46:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:47:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 17:47:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 17:47:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:47:39 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:47:39 [DEBUG   ] Finished updating board flags in 2.019 seconds
2021-03-31 17:47:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 17:48:00 [DEBUG   ] Got command RPT from MCS: ref #6500
2021-03-31 17:48:00 [DEBUG   ] summary = ERROR
2021-03-31 17:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6500  13 59304 64080817 A  ERRORERROR'
2021-03-31 17:48:00 [DEBUG   ] Got command RPT from MCS: ref #6501
2021-03-31 17:48:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6501  77 59304 64080817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:48:05 [DEBUG   ] Got command INI from MCS: ref #6502
2021-03-31 17:48:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2021-03-31 17:48:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     6502   8 59304 64085817 ABOOTING'
2021-03-31 17:48:07 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2021-03-31 17:48:29 [INFO    ] -------------------
2021-03-31 17:48:29 [INFO    ]  LWA board status
2021-03-31 17:48:29 [INFO    ] -------------------
2021-03-31 17:48:29 [INFO    ] DP 1: 2 lwa27
2021-03-31 17:48:29 [INFO    ] DP 1: 3 lwa24
2021-03-31 17:48:29 [INFO    ] DP 1: 4 lwa23
2021-03-31 17:48:29 [INFO    ] DP 1: 5 lwa18
2021-03-31 17:48:29 [INFO    ] DP 1: 6 lwa10
2021-03-31 17:48:29 [INFO    ] DP 1: 7 lwa32
2021-03-31 17:48:29 [INFO    ] DP 1: 8 lwa11
2021-03-31 17:48:29 [INFO    ] DP 1: 9 lwa30
2021-03-31 17:48:29 [INFO    ] DP 1: 10 lwa12
2021-03-31 17:48:29 [INFO    ] DP 1: 11 lwa8
2021-03-31 17:48:29 [INFO    ] DP 1: 12 lwa13
2021-03-31 17:48:29 [INFO    ] DP 1: 13 lwa26
2021-03-31 17:48:29 [INFO    ] DP 1: 14 lwa14
2021-03-31 17:48:29 [INFO    ] DP 1: 16 lwa22
2021-03-31 17:48:29 [INFO    ] DP 1: 17 lwa20
2021-03-31 17:48:29 [INFO    ] DP 1: 18 lwa1
2021-03-31 17:48:29 [INFO    ] DP 1: 19 lwa5
2021-03-31 17:48:29 [INFO    ] DP 1: 20 lwa25
2021-03-31 17:48:29 [INFO    ] DP 1: 21 lwa35
2021-03-31 17:48:29 [INFO    ] DP 1: 22 lwa19
2021-03-31 17:48:29 [INFO    ] DP 1: 23 lwa21
2021-03-31 17:48:29 [INFO    ] DP 1: 24 lwa6
2021-03-31 17:48:29 [INFO    ] DP 1: 25 lwa7
2021-03-31 17:48:29 [INFO    ] DP 1: 26 lwa33
2021-03-31 17:48:29 [INFO    ] DP 1: 27 lwa15
2021-03-31 17:48:29 [INFO    ] DP 1: 28 lwa28
2021-03-31 17:48:29 [INFO    ] DP 2: 1 lwa16
2021-03-31 17:48:29 [INFO    ] DP 2: 15 lwa34
2021-03-31 17:48:29 [INFO    ] Total of 28 boards
2021-03-31 17:48:29 [INFO    ] Total of 260 stands
2021-03-31 17:48:29 [INFO    ] -------------------
2021-03-31 17:48:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15609
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15610
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15611
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15612
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15613
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15614
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15615
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15616
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15617
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15618
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15619
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15620
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15621
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15622
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15623
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15624
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15625
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15626
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15627
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15628
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15629
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15630
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15631
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15632
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15633
2021-03-31 17:48:36 [DEBUG   ] 2021-03-31 17:48:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15634
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15609 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15610 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15611 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15612 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15613 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15614 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15615 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15616 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15617 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15618 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15619 exited with status 0
2021-03-31 17:48:48 [DEBUG   ] 2021-03-31 17:48:48 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15620 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15621 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15622 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15623 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15624 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15625 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15626 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15627 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15628 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15629 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15630 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15631 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15632 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15633 exited with status 0
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15634 exited with status 0
2021-03-31 17:48:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] spawn_process: at 2021-03-31 17:48:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15661
2021-03-31 17:48:49 [DEBUG   ] 2021-03-31 17:48:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15662
2021-03-31 17:48:54 [DEBUG   ] 2021-03-31 17:48:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15661 exited with status 0
2021-03-31 17:48:54 [DEBUG   ] 2021-03-31 17:48:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15662 exited with status 0
2021-03-31 17:48:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2021-03-31 17:48:54 [DEBUG   ] spawn_process: at 2021-03-31 17:48:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2021-03-31 17:48:54 [DEBUG   ] spawn_process: at 2021-03-31 17:48:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2021-03-31 17:48:54 [INFO    ] Setting Beam 1 xbars
2021-03-31 17:48:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2021-03-31 17:48:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2021-03-31 17:48:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2021-03-31 17:48:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2021-03-31 17:48:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2021-03-31 17:48:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2021-03-31 17:48:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2021-03-31 17:48:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2021-03-31 17:48:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2021-03-31 17:48:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2021-03-31 17:48:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2021-03-31 17:48:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2021-03-31 17:48:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2021-03-31 17:48:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2021-03-31 17:48:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2021-03-31 17:48:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2021-03-31 17:48:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2021-03-31 17:48:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2021-03-31 17:48:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2021-03-31 17:48:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2021-03-31 17:48:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2021-03-31 17:48:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2021-03-31 17:48:58 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2021-03-31 17:48:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2021-03-31 17:48:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2021-03-31 17:48:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2021-03-31 17:48:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2021-03-31 17:48:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2021-03-31 17:48:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2021-03-31 17:48:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2021-03-31 17:48:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2021-03-31 17:48:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2021-03-31 17:49:00 [INFO    ] Setting Beam 2 xbars
2021-03-31 17:49:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2021-03-31 17:49:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2021-03-31 17:49:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2021-03-31 17:49:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2021-03-31 17:49:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2021-03-31 17:49:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2021-03-31 17:49:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2021-03-31 17:49:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2021-03-31 17:49:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2021-03-31 17:49:01 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2021-03-31 17:49:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2021-03-31 17:49:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2021-03-31 17:49:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2021-03-31 17:49:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2021-03-31 17:49:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2021-03-31 17:49:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2021-03-31 17:49:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2021-03-31 17:49:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2021-03-31 17:49:02 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2021-03-31 17:49:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2021-03-31 17:49:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2021-03-31 17:49:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2021-03-31 17:49:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2021-03-31 17:49:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2021-03-31 17:49:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2021-03-31 17:49:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2021-03-31 17:49:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2021-03-31 17:49:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2021-03-31 17:49:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2021-03-31 17:49:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2021-03-31 17:49:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2021-03-31 17:49:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2021-03-31 17:49:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2021-03-31 17:49:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2021-03-31 17:49:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2021-03-31 17:49:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2021-03-31 17:49:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2021-03-31 17:49:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2021-03-31 17:49:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2021-03-31 17:49:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2021-03-31 17:49:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2021-03-31 17:49:05 [INFO    ] Setting Beam 3 xbars
2021-03-31 17:49:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2021-03-31 17:49:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2021-03-31 17:49:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2021-03-31 17:49:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2021-03-31 17:49:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2021-03-31 17:49:05 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2021-03-31 17:49:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2021-03-31 17:49:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2021-03-31 17:49:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2021-03-31 17:49:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2021-03-31 17:49:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2021-03-31 17:49:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2021-03-31 17:49:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2021-03-31 17:49:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2021-03-31 17:49:06 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2021-03-31 17:49:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2021-03-31 17:49:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2021-03-31 17:49:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2021-03-31 17:49:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2021-03-31 17:49:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2021-03-31 17:49:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2021-03-31 17:49:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2021-03-31 17:49:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2021-03-31 17:49:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2021-03-31 17:49:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2021-03-31 17:49:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2021-03-31 17:49:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2021-03-31 17:49:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2021-03-31 17:49:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2021-03-31 17:49:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2021-03-31 17:49:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2021-03-31 17:49:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2021-03-31 17:49:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2021-03-31 17:49:09 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2021-03-31 17:49:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2021-03-31 17:49:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2021-03-31 17:49:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2021-03-31 17:49:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2021-03-31 17:49:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2021-03-31 17:49:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2021-03-31 17:49:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2021-03-31 17:49:10 [INFO    ] Setting Beam 4 xbars
2021-03-31 17:49:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2021-03-31 17:49:10 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2021-03-31 17:49:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2021-03-31 17:49:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2021-03-31 17:49:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2021-03-31 17:49:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2021-03-31 17:49:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2021-03-31 17:49:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2021-03-31 17:49:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2021-03-31 17:49:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2021-03-31 17:49:11 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2021-03-31 17:49:12 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2021-03-31 17:49:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2021-03-31 17:49:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2021-03-31 17:49:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2021-03-31 17:49:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2021-03-31 17:49:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2021-03-31 17:49:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2021-03-31 17:49:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2021-03-31 17:49:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2021-03-31 17:49:13 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2021-03-31 17:49:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2021-03-31 17:49:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2021-03-31 17:49:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2021-03-31 17:49:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2021-03-31 17:49:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2021-03-31 17:49:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2021-03-31 17:49:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2021-03-31 17:49:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2021-03-31 17:49:14 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2021-03-31 17:49:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2021-03-31 17:49:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2021-03-31 17:49:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2021-03-31 17:49:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2021-03-31 17:49:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2021-03-31 17:49:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2021-03-31 17:49:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2021-03-31 17:49:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2021-03-31 17:49:15 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2021-03-31 17:49:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2021-03-31 17:49:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2021-03-31 17:49:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2021-03-31 17:49:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2021-03-31 17:49:16 [INFO    ] All xbars set
2021-03-31 17:49:16 [INFO    ] Setting adder chain routing for all beams
2021-03-31 17:49:20 [DEBUG   ] Got command RPT from MCS: ref #6509
2021-03-31 17:49:20 [DEBUG   ] summary = BOOTING
2021-03-31 17:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6509  15 59304 64160281 ABOOTINGBOOTING'
2021-03-31 17:49:20 [DEBUG   ] Got command RPT from MCS: ref #6510
2021-03-31 17:49:20 [DEBUG   ] info = Starting calibration
2021-03-31 17:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6510  28 59304 64160282 ABOOTINGStarting calibration'
2021-03-31 17:49:21 [INFO    ] Setting beam ids
2021-03-31 17:49:31 [INFO    ] Starting beam delay calibration
2021-03-31 17:49:42 [DEBUG   ] Got command RPT from MCS: ref #6528
2021-03-31 17:49:42 [DEBUG   ] summary = BOOTING
2021-03-31 17:49:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6528  15 59304 64182421 ABOOTINGBOOTING'
2021-03-31 17:49:43 [INFO    ] Beam 1 latency is 5719
2021-03-31 17:49:43 [INFO    ] Beam 2 latency is 5720
2021-03-31 17:49:43 [INFO    ] Beam 3 latency is 5720
2021-03-31 17:49:43 [INFO    ] Beam 4 latency is 5724
2021-03-31 17:49:43 [INFO    ] Stop calibration
2021-03-31 17:49:51 [INFO    ] Beam delay calibration successful
2021-03-31 17:49:51 [INFO    ] Calibration passed
2021-03-31 17:49:51 [DEBUG   ] spawn_process: at 2021-03-31 17:49:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2021-03-31 17:49:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2021-03-31 17:49:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2021-03-31 17:49:51 [DEBUG   ] spawn_process: at 2021-03-31 17:49:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2021-03-31 17:49:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2021-03-31 17:49:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2021-03-31 17:49:51 [DEBUG   ] spawn_process: at 2021-03-31 17:49:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2021-03-31 17:49:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2021-03-31 17:49:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2021-03-31 17:49:51 [DEBUG   ] spawn_process: at 2021-03-31 17:49:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2021-03-31 17:49:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2021-03-31 17:49:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2021-03-31 17:49:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2021-03-31 17:49:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 275 ms (1617212992.277 s) with PID 17240 and time 1617212993
2021-03-31 17:49:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2021-03-31 17:49:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 362 ms (1617212992.364 s) with PID 17243 and time 1617212993
2021-03-31 17:49:53 [DEBUG   ] Finished updating ant stats in 0.883 seconds
2021-03-31 17:49:53 [INFO    ] Started antennas statistics background thread
2021-03-31 17:49:53 [INFO    ] Started board flags background thread
2021-03-31 17:49:53 [INFO    ] Started BAM background thread
2021-03-31 17:49:53 [INFO    ] Finished the INI process (ref. #6502) in 107.668 s
2021-03-31 17:49:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:49:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:49:54 [DEBUG   ] Finished updating board flags in 1.073 seconds
2021-03-31 17:50:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:50:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:50:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 17:50:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:50:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:50:54 [DEBUG   ] Finished updating board flags in 0.985 seconds
2021-03-31 17:51:05 [DEBUG   ] Got command RPT from MCS: ref #6534
2021-03-31 17:51:05 [DEBUG   ] summary = ERROR
2021-03-31 17:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6534  13 59304 64265821 A  ERRORERROR'
2021-03-31 17:51:05 [DEBUG   ] Got command RPT from MCS: ref #6535
2021-03-31 17:51:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:51:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6535  77 59304 64265821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:51:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:51:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 17:51:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 17:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:51:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:51:55 [DEBUG   ] Finished updating board flags in 1.893 seconds
2021-03-31 17:52:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:52:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:52:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:52:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:52:54 [DEBUG   ] Finished updating board flags in 1.167 seconds
2021-03-31 17:53:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:53:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:53:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:53:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:53:54 [DEBUG   ] Finished updating board flags in 1.042 seconds
2021-03-31 17:54:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:54:20 [DEBUG   ] Got command RPT from MCS: ref #6542
2021-03-31 17:54:20 [DEBUG   ] summary = ERROR
2021-03-31 17:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6542  13 59304 64460289 A  ERRORERROR'
2021-03-31 17:54:20 [DEBUG   ] Got command RPT from MCS: ref #6543
2021-03-31 17:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6543  77 59304 64460289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:54:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:54:42 [DEBUG   ] Got command RPT from MCS: ref #6562
2021-03-31 17:54:42 [DEBUG   ] summary = ERROR
2021-03-31 17:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6562  13 59304 64482493 A  ERRORERROR'
2021-03-31 17:54:42 [DEBUG   ] Got command RPT from MCS: ref #6564
2021-03-31 17:54:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6564  77 59304 64482697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:54:42 [DEBUG   ] Got command RPT from MCS: ref #6566
2021-03-31 17:54:42 [DEBUG   ] summary = ERROR
2021-03-31 17:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6566  13 59304 64482889 A  ERRORERROR'
2021-03-31 17:54:43 [DEBUG   ] Got command RPT from MCS: ref #6568
2021-03-31 17:54:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:54:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6568  77 59304 64483093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:54:43 [DEBUG   ] Got command RPT from MCS: ref #6569
2021-03-31 17:54:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:54:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6569  12 59304 64483297 A  ERRORB—™š'
2021-03-31 17:54:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:54:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:54:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:54:54 [DEBUG   ] Finished updating board flags in 0.976 seconds
2021-03-31 17:55:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 17:55:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:55:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:55:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:55:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:55:55 [DEBUG   ] Finished updating board flags in 1.348 seconds
2021-03-31 17:56:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:56:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:56:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 17:56:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:56:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:56:55 [DEBUG   ] Finished updating board flags in 1.250 seconds
2021-03-31 17:57:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 17:57:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:57:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:57:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:57:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:57:55 [DEBUG   ] Finished updating board flags in 1.152 seconds
2021-03-31 17:58:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:58:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:58:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:58:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:58:55 [DEBUG   ] Finished updating board flags in 1.033 seconds
2021-03-31 17:59:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:59:20 [DEBUG   ] Got command RPT from MCS: ref #6576
2021-03-31 17:59:20 [DEBUG   ] summary = ERROR
2021-03-31 17:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6576  13 59304 64760289 A  ERRORERROR'
2021-03-31 17:59:20 [DEBUG   ] Got command RPT from MCS: ref #6577
2021-03-31 17:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6577  77 59304 64760289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:59:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:59:42 [DEBUG   ] Got command RPT from MCS: ref #6595
2021-03-31 17:59:42 [DEBUG   ] summary = ERROR
2021-03-31 17:59:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6595  13 59304 64782565 A  ERRORERROR'
2021-03-31 17:59:42 [DEBUG   ] Got command RPT from MCS: ref #6596
2021-03-31 17:59:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:59:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6596  77 59304 64782769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:59:42 [DEBUG   ] Got command RPT from MCS: ref #6597
2021-03-31 17:59:42 [DEBUG   ] summary = ERROR
2021-03-31 17:59:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6597  13 59304 64782961 A  ERRORERROR'
2021-03-31 17:59:43 [DEBUG   ] Got command RPT from MCS: ref #6598
2021-03-31 17:59:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 17:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6598  77 59304 64783165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 17:59:43 [DEBUG   ] Got command RPT from MCS: ref #6599
2021-03-31 17:59:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 17:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6599  12 59304 64783369 A  ERRORB™™š'
2021-03-31 17:59:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 17:59:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 17:59:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 17:59:56 [DEBUG   ] Finished updating board flags in 2.009 seconds
2021-03-31 18:00:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:00:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:00:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:00:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:00:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:00:56 [DEBUG   ] Finished updating board flags in 1.948 seconds
2021-03-31 18:01:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:01:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:01:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:01:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:01:55 [DEBUG   ] Finished updating board flags in 1.266 seconds
2021-03-31 18:02:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:02:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:02:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:02:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:02:55 [DEBUG   ] Finished updating board flags in 1.242 seconds
2021-03-31 18:03:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:03:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:03:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:03:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:03:55 [DEBUG   ] Finished updating board flags in 1.211 seconds
2021-03-31 18:04:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:04:20 [DEBUG   ] Got command RPT from MCS: ref #6617
2021-03-31 18:04:20 [DEBUG   ] summary = ERROR
2021-03-31 18:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6617  13 59304 65060293 A  ERRORERROR'
2021-03-31 18:04:20 [DEBUG   ] Got command RPT from MCS: ref #6618
2021-03-31 18:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6618  77 59304 65060293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:04:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:04:42 [DEBUG   ] Got command RPT from MCS: ref #6634
2021-03-31 18:04:42 [DEBUG   ] summary = ERROR
2021-03-31 18:04:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6634  13 59304 65082646 A  ERRORERROR'
2021-03-31 18:04:42 [DEBUG   ] Got command RPT from MCS: ref #6635
2021-03-31 18:04:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:04:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6635  77 59304 65082837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:04:43 [DEBUG   ] Got command RPT from MCS: ref #6636
2021-03-31 18:04:43 [DEBUG   ] summary = ERROR
2021-03-31 18:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6636  13 59304 65083041 A  ERRORERROR'
2021-03-31 18:04:43 [DEBUG   ] Got command RPT from MCS: ref #6637
2021-03-31 18:04:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6637  77 59304 65083233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:04:43 [DEBUG   ] Got command RPT from MCS: ref #6638
2021-03-31 18:04:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6638  12 59304 65083437 A  ERRORB˜™š'
2021-03-31 18:04:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 18:04:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:04:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:04:55 [DEBUG   ] Finished updating board flags in 1.161 seconds
2021-03-31 18:05:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:05:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:05:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:05:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:05:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:05:56 [DEBUG   ] Finished updating board flags in 1.578 seconds
2021-03-31 18:06:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:06:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:06:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:06:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:06:56 [DEBUG   ] Finished updating board flags in 1.352 seconds
2021-03-31 18:07:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 18:07:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:07:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:07:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:07:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:07:56 [DEBUG   ] Finished updating board flags in 1.221 seconds
2021-03-31 18:08:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 18:08:19 [DEBUG   ] Got command BAM from MCS: ref #6650
2021-03-31 18:08:19 [INFO    ] Finished processing BAM request
2021-03-31 18:08:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6650   8 59304 65299029 A  ERROR'
2021-03-31 18:08:19 [DEBUG   ] Got command BAM from MCS: ref #6649
2021-03-31 18:08:19 [INFO    ] Finished processing BAM request
2021-03-31 18:08:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6649   8 59304 65299033 A  ERROR'
2021-03-31 18:08:19 [DEBUG   ] Got command DRX from MCS: ref #6652
2021-03-31 18:08:19 [INFO    ] sending drx command to lwa16
2021-03-31 18:08:19 [DEBUG   ] run_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 64500000.0 7 9 82']
2021-03-31 18:08:19 [DEBUG   ] drx = exited with status True, code 0x00
2021-03-31 18:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6652   8 59304 65299829 A  ERROR'
2021-03-31 18:08:19 [DEBUG   ] Got command DRX from MCS: ref #6651
2021-03-31 18:08:19 [INFO    ] sending drx command to lwa16
2021-03-31 18:08:19 [DEBUG   ] run_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35100000.0 7 9 82']
2021-03-31 18:08:19 [DEBUG   ] drx = exited with status True, code 0x00
2021-03-31 18:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6651   8 59304 65299833 A  ERROR'
2021-03-31 18:08:19 [DEBUG   ] Got command DRX from MCS: ref #6653
2021-03-31 18:08:19 [INFO    ] sending drx command to lwa16
2021-03-31 18:08:19 [DEBUG   ] run_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 49800000.0 7 9 82']
2021-03-31 18:08:19 [DEBUG   ] drx = exited with status True, code 0x00
2021-03-31 18:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6653   8 59304 65299837 A  ERROR'
2021-03-31 18:08:19 [DEBUG   ] Got command DRX from MCS: ref #6654
2021-03-31 18:08:19 [INFO    ] sending drx command to lwa16
2021-03-31 18:08:19 [DEBUG   ] run_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 79200000.0 7 9 82']
2021-03-31 18:08:19 [DEBUG   ] drx = exited with status True, code 0x00
2021-03-31 18:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6654   8 59304 65299841 A  ERROR'
2021-03-31 18:08:19 [INFO    ] Finished starting DRX
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:08:19 [INFO    ] Finished starting DRX
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:08:19 [INFO    ] Finished starting DRX
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:08:19 [DEBUG   ] spawn_process: at 2021-03-31 18:08:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:08:19 [INFO    ] Finished starting DRX
2021-03-31 18:08:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:08:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:08:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:08:56 [DEBUG   ] Finished updating board flags in 1.186 seconds
2021-03-31 18:09:08 [DEBUG   ] Got command BAM from MCS: ref #6658
2021-03-31 18:09:08 [INFO    ] Finished processing BAM request
2021-03-31 18:09:08 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6658   8 59304 65348025 A  ERROR'
2021-03-31 18:09:08 [DEBUG   ] Got command BAM from MCS: ref #6657
2021-03-31 18:09:08 [INFO    ] Finished processing BAM request
2021-03-31 18:09:08 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6657   8 59304 65348029 A  ERROR'
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:09:08 [DEBUG   ] spawn_process: at 2021-03-31 18:09:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:09:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:09:20 [DEBUG   ] Got command RPT from MCS: ref #6659
2021-03-31 18:09:20 [DEBUG   ] summary = ERROR
2021-03-31 18:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6659  13 59304 65360293 A  ERRORERROR'
2021-03-31 18:09:20 [DEBUG   ] Got command RPT from MCS: ref #6660
2021-03-31 18:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6660  77 59304 65360293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:09:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:09:42 [DEBUG   ] Got command RPT from MCS: ref #6681
2021-03-31 18:09:42 [DEBUG   ] summary = ERROR
2021-03-31 18:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6681  13 59304 65382709 A  ERRORERROR'
2021-03-31 18:09:42 [DEBUG   ] Got command RPT from MCS: ref #6683
2021-03-31 18:09:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:09:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6683  77 59304 65382913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:09:43 [DEBUG   ] Got command RPT from MCS: ref #6685
2021-03-31 18:09:43 [DEBUG   ] summary = ERROR
2021-03-31 18:09:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6685  13 59304 65383117 A  ERRORERROR'
2021-03-31 18:09:43 [DEBUG   ] Got command RPT from MCS: ref #6687
2021-03-31 18:09:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:09:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6687  77 59304 65383309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:09:43 [DEBUG   ] Got command RPT from MCS: ref #6688
2021-03-31 18:09:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:09:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6688  12 59304 65383513 A  ERRORB›™š'
2021-03-31 18:09:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:09:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:09:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:09:56 [DEBUG   ] Finished updating board flags in 1.049 seconds
2021-03-31 18:09:57 [DEBUG   ] Got command BAM from MCS: ref #6694
2021-03-31 18:09:57 [INFO    ] Finished processing BAM request
2021-03-31 18:09:57 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6694   8 59304 65397025 A  ERROR'
2021-03-31 18:09:57 [DEBUG   ] Got command BAM from MCS: ref #6695
2021-03-31 18:09:57 [INFO    ] Finished processing BAM request
2021-03-31 18:09:57 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6695   8 59304 65397029 A  ERROR'
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:09:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:09:57 [DEBUG   ] spawn_process: at 2021-03-31 18:09:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:10:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:10:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:10:46 [DEBUG   ] Got command BAM from MCS: ref #6697
2021-03-31 18:10:46 [INFO    ] Finished processing BAM request
2021-03-31 18:10:46 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:10:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6697   8 59304 65446033 A  ERROR'
2021-03-31 18:10:46 [DEBUG   ] Got command BAM from MCS: ref #6696
2021-03-31 18:10:46 [INFO    ] Finished processing BAM request
2021-03-31 18:10:46 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:10:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6696   8 59304 65446037 A  ERROR'
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:10:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:10:46 [DEBUG   ] spawn_process: at 2021-03-31 18:10:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:10:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:10:57 [DEBUG   ] Finished updating board flags in 2.001 seconds
2021-03-31 18:11:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:11:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:11:35 [DEBUG   ] Got command BAM from MCS: ref #6699
2021-03-31 18:11:35 [INFO    ] Finished processing BAM request
2021-03-31 18:11:35 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6699   8 59304 65495025 A  ERROR'
2021-03-31 18:11:35 [DEBUG   ] Got command BAM from MCS: ref #6698
2021-03-31 18:11:35 [INFO    ] Finished processing BAM request
2021-03-31 18:11:35 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:11:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6698   8 59304 65495029 A  ERROR'
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:11:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:11:35 [DEBUG   ] spawn_process: at 2021-03-31 18:11:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:11:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 18:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:11:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 18:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:11:57 [DEBUG   ] Finished updating board flags in 1.968 seconds
2021-03-31 18:12:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:12:24 [DEBUG   ] Got command BAM from MCS: ref #6700
2021-03-31 18:12:24 [INFO    ] Finished processing BAM request
2021-03-31 18:12:24 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6700   8 59304 65544033 A  ERROR'
2021-03-31 18:12:24 [DEBUG   ] Got command BAM from MCS: ref #6701
2021-03-31 18:12:24 [INFO    ] Finished processing BAM request
2021-03-31 18:12:24 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:12:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6701   8 59304 65544037 A  ERROR'
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:12:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:12:24 [DEBUG   ] spawn_process: at 2021-03-31 18:12:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:12:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:12:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:12:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:12:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:12:56 [DEBUG   ] Finished updating board flags in 1.274 seconds
2021-03-31 18:13:13 [DEBUG   ] Got command BAM from MCS: ref #6708
2021-03-31 18:13:13 [INFO    ] Finished processing BAM request
2021-03-31 18:13:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6708   8 59304 65593029 A  ERROR'
2021-03-31 18:13:13 [DEBUG   ] Got command BAM from MCS: ref #6709
2021-03-31 18:13:13 [INFO    ] Finished processing BAM request
2021-03-31 18:13:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6709   8 59304 65593033 A  ERROR'
2021-03-31 18:13:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:13:13 [DEBUG   ] spawn_process: at 2021-03-31 18:13:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:13:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:13:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 18:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:13:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-03-31 18:13:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:13:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:13:56 [DEBUG   ] Finished updating board flags in 1.214 seconds
2021-03-31 18:14:02 [DEBUG   ] Got command BAM from MCS: ref #6711
2021-03-31 18:14:02 [INFO    ] Finished processing BAM request
2021-03-31 18:14:02 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:14:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6711   8 59304 65642033 A  ERROR'
2021-03-31 18:14:02 [DEBUG   ] Got command BAM from MCS: ref #6710
2021-03-31 18:14:02 [INFO    ] Finished processing BAM request
2021-03-31 18:14:02 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:14:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6710   8 59304 65642037 A  ERROR'
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:14:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:14:02 [DEBUG   ] spawn_process: at 2021-03-31 18:14:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:14:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:14:20 [DEBUG   ] Got command RPT from MCS: ref #6712
2021-03-31 18:14:20 [DEBUG   ] summary = ERROR
2021-03-31 18:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6712  13 59304 65660297 A  ERRORERROR'
2021-03-31 18:14:20 [DEBUG   ] Got command RPT from MCS: ref #6713
2021-03-31 18:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6713  77 59304 65660297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:14:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:14:42 [DEBUG   ] Got command RPT from MCS: ref #6729
2021-03-31 18:14:42 [DEBUG   ] summary = ERROR
2021-03-31 18:14:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6729  13 59304 65682789 A  ERRORERROR'
2021-03-31 18:14:42 [DEBUG   ] Got command RPT from MCS: ref #6730
2021-03-31 18:14:42 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:14:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6730  77 59304 65682981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:14:43 [DEBUG   ] Got command RPT from MCS: ref #6731
2021-03-31 18:14:43 [DEBUG   ] summary = ERROR
2021-03-31 18:14:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6731  13 59304 65683185 A  ERRORERROR'
2021-03-31 18:14:43 [DEBUG   ] Got command RPT from MCS: ref #6732
2021-03-31 18:14:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:14:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6732  77 59304 65683400 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:14:43 [DEBUG   ] Got command RPT from MCS: ref #6733
2021-03-31 18:14:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:14:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6733  12 59304 65683589 A  ERRORB ff'
2021-03-31 18:14:51 [DEBUG   ] Got command BAM from MCS: ref #6735
2021-03-31 18:14:51 [INFO    ] Finished processing BAM request
2021-03-31 18:14:51 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6735   8 59304 65691025 A  ERROR'
2021-03-31 18:14:51 [DEBUG   ] Got command BAM from MCS: ref #6734
2021-03-31 18:14:51 [INFO    ] Finished processing BAM request
2021-03-31 18:14:51 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6734   8 59304 65691029 A  ERROR'
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:14:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:14:51 [DEBUG   ] spawn_process: at 2021-03-31 18:14:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:14:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:14:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:14:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 18:14:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:14:56 [DEBUG   ] Finished updating board flags in 1.156 seconds
2021-03-31 18:15:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:15:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:15:40 [DEBUG   ] Got command BAM from MCS: ref #6737
2021-03-31 18:15:40 [INFO    ] Finished processing BAM request
2021-03-31 18:15:40 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6737   8 59304 65740033 A  ERROR'
2021-03-31 18:15:40 [DEBUG   ] Got command BAM from MCS: ref #6736
2021-03-31 18:15:40 [INFO    ] Finished processing BAM request
2021-03-31 18:15:40 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:15:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6736   8 59304 65740037 A  ERROR'
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:15:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:15:40 [DEBUG   ] spawn_process: at 2021-03-31 18:15:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:15:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:15:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:15:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:15:56 [DEBUG   ] Finished updating board flags in 1.033 seconds
2021-03-31 18:16:13 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-03-31 18:16:29 [DEBUG   ] Got command BAM from MCS: ref #6745
2021-03-31 18:16:29 [INFO    ] Finished processing BAM request
2021-03-31 18:16:29 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6745   8 59304 65789025 A  ERROR'
2021-03-31 18:16:29 [DEBUG   ] Got command BAM from MCS: ref #6744
2021-03-31 18:16:29 [INFO    ] Finished processing BAM request
2021-03-31 18:16:29 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6744   8 59304 65789029 A  ERROR'
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:16:29 [DEBUG   ] spawn_process: at 2021-03-31 18:16:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:16:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:16:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:16:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:16:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:16:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:16:56 [DEBUG   ] Finished updating board flags in 0.961 seconds
2021-03-31 18:17:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:17:18 [DEBUG   ] Got command BAM from MCS: ref #6746
2021-03-31 18:17:18 [INFO    ] Finished processing BAM request
2021-03-31 18:17:18 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6746   8 59304 65838025 A  ERROR'
2021-03-31 18:17:18 [DEBUG   ] Got command BAM from MCS: ref #6747
2021-03-31 18:17:18 [INFO    ] Finished processing BAM request
2021-03-31 18:17:18 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:17:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6747   8 59304 65838029 A  ERROR'
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:17:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:17:18 [DEBUG   ] spawn_process: at 2021-03-31 18:17:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:17:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:17:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:17:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:17:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:17:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:17:57 [DEBUG   ] Finished updating board flags in 1.398 seconds
2021-03-31 18:18:07 [DEBUG   ] Got command BAM from MCS: ref #6748
2021-03-31 18:18:07 [INFO    ] Finished processing BAM request
2021-03-31 18:18:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6748   8 59304 65887029 A  ERROR'
2021-03-31 18:18:07 [DEBUG   ] Got command BAM from MCS: ref #6749
2021-03-31 18:18:07 [INFO    ] Finished processing BAM request
2021-03-31 18:18:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:18:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6749   8 59304 65887033 A  ERROR'
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:18:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:18:07 [DEBUG   ] spawn_process: at 2021-03-31 18:18:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:18:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:18:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:18:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:18:56 [DEBUG   ] Got command BAM from MCS: ref #6756
2021-03-31 18:18:56 [INFO    ] Finished processing BAM request
2021-03-31 18:18:56 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6756   8 59304 65936025 A  ERROR'
2021-03-31 18:18:56 [DEBUG   ] Got command BAM from MCS: ref #6757
2021-03-31 18:18:56 [INFO    ] Finished processing BAM request
2021-03-31 18:18:56 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:18:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6757   8 59304 65936029 A  ERROR'
2021-03-31 18:18:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:18:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:18:56 [DEBUG   ] spawn_process: at 2021-03-31 18:18:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:18:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:18:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:18:57 [DEBUG   ] Finished updating board flags in 1.167 seconds
2021-03-31 18:19:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:19:20 [DEBUG   ] Got command RPT from MCS: ref #6758
2021-03-31 18:19:20 [DEBUG   ] summary = ERROR
2021-03-31 18:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6758  13 59304 65960289 A  ERRORERROR'
2021-03-31 18:19:20 [DEBUG   ] Got command RPT from MCS: ref #6759
2021-03-31 18:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6759  77 59304 65960289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:19:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:19:42 [DEBUG   ] Got command RPT from MCS: ref #6777
2021-03-31 18:19:42 [DEBUG   ] summary = ERROR
2021-03-31 18:19:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6777  13 59304 65982853 A  ERRORERROR'
2021-03-31 18:19:43 [DEBUG   ] Got command RPT from MCS: ref #6778
2021-03-31 18:19:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:19:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6778  77 59304 65983057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:19:43 [DEBUG   ] Got command RPT from MCS: ref #6779
2021-03-31 18:19:43 [DEBUG   ] summary = ERROR
2021-03-31 18:19:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6779  13 59304 65983261 A  ERRORERROR'
2021-03-31 18:19:43 [DEBUG   ] Got command RPT from MCS: ref #6780
2021-03-31 18:19:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:19:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6780  77 59304 65983453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:19:43 [DEBUG   ] Got command RPT from MCS: ref #6782
2021-03-31 18:19:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:19:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6782  12 59304 65983657 A  ERRORB ff'
2021-03-31 18:19:45 [DEBUG   ] Got command BAM from MCS: ref #6784
2021-03-31 18:19:45 [INFO    ] Finished processing BAM request
2021-03-31 18:19:45 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6784   8 59304 65985029 A  ERROR'
2021-03-31 18:19:45 [DEBUG   ] Got command BAM from MCS: ref #6785
2021-03-31 18:19:45 [INFO    ] Finished processing BAM request
2021-03-31 18:19:45 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6785   8 59304 65985033 A  ERROR'
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:19:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:19:45 [DEBUG   ] spawn_process: at 2021-03-31 18:19:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:19:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:19:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:19:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:19:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:19:57 [DEBUG   ] Finished updating board flags in 1.025 seconds
2021-03-31 18:20:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:20:34 [DEBUG   ] Got command BAM from MCS: ref #6789
2021-03-31 18:20:34 [INFO    ] Finished processing BAM request
2021-03-31 18:20:34 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:20:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6789   8 59304 66034025 A  ERROR'
2021-03-31 18:20:34 [DEBUG   ] Got command BAM from MCS: ref #6790
2021-03-31 18:20:34 [INFO    ] Finished processing BAM request
2021-03-31 18:20:34 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:20:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6790   8 59304 66034029 A  ERROR'
2021-03-31 18:20:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:20:34 [DEBUG   ] spawn_process: at 2021-03-31 18:20:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:20:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:20:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:20:58 [DEBUG   ] Finished updating board flags in 2.006 seconds
2021-03-31 18:21:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:21:23 [DEBUG   ] Got command BAM from MCS: ref #6791
2021-03-31 18:21:23 [INFO    ] Finished processing BAM request
2021-03-31 18:21:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6791   8 59304 66083029 A  ERROR'
2021-03-31 18:21:23 [DEBUG   ] Got command BAM from MCS: ref #6792
2021-03-31 18:21:23 [INFO    ] Finished processing BAM request
2021-03-31 18:21:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6792   8 59304 66083033 A  ERROR'
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:21:23 [DEBUG   ] spawn_process: at 2021-03-31 18:21:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:21:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:21:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-03-31 18:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:21:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:21:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 18:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:21:57 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 18:22:12 [DEBUG   ] Got command BAM from MCS: ref #6799
2021-03-31 18:22:12 [INFO    ] Finished processing BAM request
2021-03-31 18:22:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6799   8 59304 66132025 A  ERROR'
2021-03-31 18:22:12 [DEBUG   ] Got command BAM from MCS: ref #6800
2021-03-31 18:22:12 [INFO    ] Finished processing BAM request
2021-03-31 18:22:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:22:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6800   8 59304 66132029 A  ERROR'
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:22:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:22:12 [DEBUG   ] spawn_process: at 2021-03-31 18:22:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:22:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:22:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:22:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:22:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:22:57 [DEBUG   ] Finished updating board flags in 1.470 seconds
2021-03-31 18:23:01 [DEBUG   ] Got command BAM from MCS: ref #6801
2021-03-31 18:23:01 [INFO    ] Finished processing BAM request
2021-03-31 18:23:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:23:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6801   8 59304 66181029 A  ERROR'
2021-03-31 18:23:01 [DEBUG   ] Got command BAM from MCS: ref #6802
2021-03-31 18:23:01 [INFO    ] Finished processing BAM request
2021-03-31 18:23:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:23:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6802   8 59304 66181033 A  ERROR'
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:23:01 [DEBUG   ] spawn_process: at 2021-03-31 18:23:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:23:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:23:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:23:50 [DEBUG   ] Got command BAM from MCS: ref #6803
2021-03-31 18:23:50 [INFO    ] Finished processing BAM request
2021-03-31 18:23:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6803   8 59304 66230033 A  ERROR'
2021-03-31 18:23:50 [DEBUG   ] Got command BAM from MCS: ref #6804
2021-03-31 18:23:50 [INFO    ] Finished processing BAM request
2021-03-31 18:23:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:23:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6804   8 59304 66230037 A  ERROR'
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:23:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:23:50 [DEBUG   ] spawn_process: at 2021-03-31 18:23:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:23:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 18:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:23:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:23:57 [DEBUG   ] Finished updating board flags in 1.410 seconds
2021-03-31 18:24:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:24:20 [DEBUG   ] Got command RPT from MCS: ref #6805
2021-03-31 18:24:20 [DEBUG   ] summary = ERROR
2021-03-31 18:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6805  13 59304 66260289 A  ERRORERROR'
2021-03-31 18:24:20 [DEBUG   ] Got command RPT from MCS: ref #6806
2021-03-31 18:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6806  77 59304 66260289 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:24:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:24:39 [DEBUG   ] Got command BAM from MCS: ref #6822
2021-03-31 18:24:39 [INFO    ] Finished processing BAM request
2021-03-31 18:24:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6822   8 59304 66279025 A  ERROR'
2021-03-31 18:24:39 [DEBUG   ] Got command BAM from MCS: ref #6823
2021-03-31 18:24:39 [INFO    ] Finished processing BAM request
2021-03-31 18:24:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6823   8 59304 66279029 A  ERROR'
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:24:39 [DEBUG   ] spawn_process: at 2021-03-31 18:24:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:24:42 [DEBUG   ] Got command RPT from MCS: ref #6827
2021-03-31 18:24:42 [DEBUG   ] summary = ERROR
2021-03-31 18:24:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6827  13 59304 66282929 A  ERRORERROR'
2021-03-31 18:24:43 [DEBUG   ] Got command RPT from MCS: ref #6829
2021-03-31 18:24:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6829  77 59304 66283133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:24:43 [DEBUG   ] Got command RPT from MCS: ref #6831
2021-03-31 18:24:43 [DEBUG   ] summary = ERROR
2021-03-31 18:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6831  13 59304 66283325 A  ERRORERROR'
2021-03-31 18:24:43 [DEBUG   ] Got command RPT from MCS: ref #6833
2021-03-31 18:24:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6833  77 59304 66283529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:24:43 [DEBUG   ] Got command RPT from MCS: ref #6834
2021-03-31 18:24:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6834  12 59304 66283733 A  ERRORB¡ff'
2021-03-31 18:24:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:24:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:24:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:24:57 [DEBUG   ] Finished updating board flags in 1.338 seconds
2021-03-31 18:25:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:25:28 [DEBUG   ] Got command BAM from MCS: ref #6836
2021-03-31 18:25:28 [INFO    ] Finished processing BAM request
2021-03-31 18:25:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6836   8 59304 66328029 A  ERROR'
2021-03-31 18:25:28 [DEBUG   ] Got command BAM from MCS: ref #6835
2021-03-31 18:25:28 [INFO    ] Finished processing BAM request
2021-03-31 18:25:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:25:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6835   8 59304 66328033 A  ERROR'
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:25:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:25:28 [DEBUG   ] spawn_process: at 2021-03-31 18:25:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:25:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:25:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:25:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:25:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:25:57 [DEBUG   ] Finished updating board flags in 1.223 seconds
2021-03-31 18:26:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:26:17 [DEBUG   ] Got command BAM from MCS: ref #6837
2021-03-31 18:26:17 [INFO    ] Finished processing BAM request
2021-03-31 18:26:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:26:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6837   8 59304 66377025 A  ERROR'
2021-03-31 18:26:17 [DEBUG   ] Got command BAM from MCS: ref #6838
2021-03-31 18:26:17 [INFO    ] Finished processing BAM request
2021-03-31 18:26:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:26:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6838   8 59304 66377029 A  ERROR'
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:26:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:26:17 [DEBUG   ] spawn_process: at 2021-03-31 18:26:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:26:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:26:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:26:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:26:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:26:57 [DEBUG   ] Finished updating board flags in 1.172 seconds
2021-03-31 18:27:06 [DEBUG   ] Got command BAM from MCS: ref #6839
2021-03-31 18:27:06 [INFO    ] Finished processing BAM request
2021-03-31 18:27:06 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:27:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6839   8 59304 66426025 A  ERROR'
2021-03-31 18:27:06 [DEBUG   ] Got command BAM from MCS: ref #6840
2021-03-31 18:27:06 [INFO    ] Finished processing BAM request
2021-03-31 18:27:06 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:27:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6840   8 59304 66426029 A  ERROR'
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:27:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:27:06 [DEBUG   ] spawn_process: at 2021-03-31 18:27:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:27:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:27:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:27:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:27:55 [DEBUG   ] Got command BAM from MCS: ref #6847
2021-03-31 18:27:55 [INFO    ] Finished processing BAM request
2021-03-31 18:27:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:27:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6847   8 59304 66475033 A  ERROR'
2021-03-31 18:27:55 [DEBUG   ] Got command BAM from MCS: ref #6848
2021-03-31 18:27:55 [INFO    ] Finished processing BAM request
2021-03-31 18:27:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:27:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6848   8 59304 66475037 A  ERROR'
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:27:55 [DEBUG   ] spawn_process: at 2021-03-31 18:27:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-03-31 18:27:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:27:57 [DEBUG   ] Finished updating board flags in 1.016 seconds
2021-03-31 18:28:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:28:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:28:44 [DEBUG   ] Got command BAM from MCS: ref #6849
2021-03-31 18:28:44 [INFO    ] Finished processing BAM request
2021-03-31 18:28:44 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6849   8 59304 66524033 A  ERROR'
2021-03-31 18:28:44 [DEBUG   ] Got command BAM from MCS: ref #6850
2021-03-31 18:28:44 [INFO    ] Finished processing BAM request
2021-03-31 18:28:44 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:28:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6850   8 59304 66524037 A  ERROR'
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:28:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:28:44 [DEBUG   ] spawn_process: at 2021-03-31 18:28:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:28:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:28:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:28:58 [DEBUG   ] Finished updating board flags in 1.549 seconds
2021-03-31 18:29:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:29:20 [DEBUG   ] Got command RPT from MCS: ref #6851
2021-03-31 18:29:20 [DEBUG   ] summary = ERROR
2021-03-31 18:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6851  13 59304 66560301 A  ERRORERROR'
2021-03-31 18:29:20 [DEBUG   ] Got command RPT from MCS: ref #6852
2021-03-31 18:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6852  77 59304 66560301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:29:33 [DEBUG   ] Got command BAM from MCS: ref #6869
2021-03-31 18:29:33 [INFO    ] Finished processing BAM request
2021-03-31 18:29:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6869   8 59304 66573025 A  ERROR'
2021-03-31 18:29:33 [DEBUG   ] Got command BAM from MCS: ref #6868
2021-03-31 18:29:33 [INFO    ] Finished processing BAM request
2021-03-31 18:29:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6868   8 59304 66573029 A  ERROR'
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:29:33 [DEBUG   ] spawn_process: at 2021-03-31 18:29:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:29:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:29:43 [DEBUG   ] Got command RPT from MCS: ref #6872
2021-03-31 18:29:43 [DEBUG   ] summary = ERROR
2021-03-31 18:29:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6872  13 59304 66583001 A  ERRORERROR'
2021-03-31 18:29:43 [DEBUG   ] Got command RPT from MCS: ref #6873
2021-03-31 18:29:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:29:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6873  77 59304 66583193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:29:43 [DEBUG   ] Got command RPT from MCS: ref #6874
2021-03-31 18:29:43 [DEBUG   ] summary = ERROR
2021-03-31 18:29:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6874  13 59304 66583397 A  ERRORERROR'
2021-03-31 18:29:43 [DEBUG   ] Got command RPT from MCS: ref #6875
2021-03-31 18:29:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:29:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6875  77 59304 66583601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:29:43 [DEBUG   ] Got command RPT from MCS: ref #6877
2021-03-31 18:29:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:29:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6877  12 59304 66583805 A  ERRORBŸff'
2021-03-31 18:29:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:29:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:29:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:29:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:29:58 [DEBUG   ] Finished updating board flags in 1.416 seconds
2021-03-31 18:30:14 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2021-03-31 18:30:22 [DEBUG   ] Got command BAM from MCS: ref #6883
2021-03-31 18:30:22 [INFO    ] Finished processing BAM request
2021-03-31 18:30:22 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6883   8 59304 66622025 A  ERROR'
2021-03-31 18:30:22 [DEBUG   ] Got command BAM from MCS: ref #6882
2021-03-31 18:30:22 [INFO    ] Finished processing BAM request
2021-03-31 18:30:22 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:30:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6882   8 59304 66622029 A  ERROR'
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:30:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:30:22 [DEBUG   ] spawn_process: at 2021-03-31 18:30:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:30:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 18:30:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 18:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 18:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:30:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:30:58 [DEBUG   ] Finished updating board flags in 1.387 seconds
2021-03-31 18:31:11 [DEBUG   ] Got command BAM from MCS: ref #6890
2021-03-31 18:31:11 [INFO    ] Finished processing BAM request
2021-03-31 18:31:11 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6890   8 59304 66671029 A  ERROR'
2021-03-31 18:31:11 [DEBUG   ] Got command BAM from MCS: ref #6891
2021-03-31 18:31:11 [INFO    ] Finished processing BAM request
2021-03-31 18:31:11 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:31:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6891   8 59304 66671033 A  ERROR'
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:31:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:31:11 [DEBUG   ] spawn_process: at 2021-03-31 18:31:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:31:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 18:31:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 18:31:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:31:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:31:58 [DEBUG   ] Finished updating board flags in 1.210 seconds
2021-03-31 18:32:00 [DEBUG   ] Got command BAM from MCS: ref #6892
2021-03-31 18:32:00 [INFO    ] Finished processing BAM request
2021-03-31 18:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6892   8 59304 66720029 A  ERROR'
2021-03-31 18:32:00 [DEBUG   ] Got command BAM from MCS: ref #6893
2021-03-31 18:32:00 [INFO    ] Finished processing BAM request
2021-03-31 18:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6893   8 59304 66720033 A  ERROR'
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:32:00 [DEBUG   ] spawn_process: at 2021-03-31 18:32:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:32:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:32:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:32:49 [DEBUG   ] Got command BAM from MCS: ref #6894
2021-03-31 18:32:49 [INFO    ] Finished processing BAM request
2021-03-31 18:32:49 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6894   8 59304 66769025 A  ERROR'
2021-03-31 18:32:49 [DEBUG   ] Got command BAM from MCS: ref #6895
2021-03-31 18:32:49 [INFO    ] Finished processing BAM request
2021-03-31 18:32:49 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6895   8 59304 66769029 A  ERROR'
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:32:49 [DEBUG   ] spawn_process: at 2021-03-31 18:32:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:32:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:32:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 18:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:32:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:32:58 [DEBUG   ] Finished updating board flags in 1.263 seconds
2021-03-31 18:33:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 18:33:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:33:38 [DEBUG   ] Got command BAM from MCS: ref #6896
2021-03-31 18:33:38 [INFO    ] Finished processing BAM request
2021-03-31 18:33:38 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6896   8 59304 66818033 A  ERROR'
2021-03-31 18:33:38 [DEBUG   ] Got command BAM from MCS: ref #6897
2021-03-31 18:33:38 [INFO    ] Finished processing BAM request
2021-03-31 18:33:38 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6897   8 59304 66818037 A  ERROR'
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:33:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:33:38 [DEBUG   ] spawn_process: at 2021-03-31 18:33:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:33:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:33:58 [DEBUG   ] Finished updating board flags in 1.137 seconds
2021-03-31 18:34:14 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-03-31 18:34:20 [DEBUG   ] Got command RPT from MCS: ref #6904
2021-03-31 18:34:20 [DEBUG   ] summary = ERROR
2021-03-31 18:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6904  13 59304 66860297 A  ERRORERROR'
2021-03-31 18:34:20 [DEBUG   ] Got command RPT from MCS: ref #6905
2021-03-31 18:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6905  77 59304 66860297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:34:27 [DEBUG   ] Got command BAM from MCS: ref #6922
2021-03-31 18:34:27 [INFO    ] Finished processing BAM request
2021-03-31 18:34:27 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6922   8 59304 66867033 A  ERROR'
2021-03-31 18:34:27 [DEBUG   ] Got command BAM from MCS: ref #6921
2021-03-31 18:34:27 [INFO    ] Finished processing BAM request
2021-03-31 18:34:27 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6921   8 59304 66867037 A  ERROR'
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:34:27 [DEBUG   ] spawn_process: at 2021-03-31 18:34:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:34:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:34:43 [DEBUG   ] Got command RPT from MCS: ref #6923
2021-03-31 18:34:43 [DEBUG   ] summary = ERROR
2021-03-31 18:34:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6923  13 59304 66883069 A  ERRORERROR'
2021-03-31 18:34:43 [DEBUG   ] Got command RPT from MCS: ref #6924
2021-03-31 18:34:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:34:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6924  77 59304 66883273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:34:43 [DEBUG   ] Got command RPT from MCS: ref #6925
2021-03-31 18:34:43 [DEBUG   ] summary = ERROR
2021-03-31 18:34:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6925  13 59304 66883465 A  ERRORERROR'
2021-03-31 18:34:43 [DEBUG   ] Got command RPT from MCS: ref #6926
2021-03-31 18:34:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:34:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6926  77 59304 66883669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:34:43 [DEBUG   ] Got command RPT from MCS: ref #6927
2021-03-31 18:34:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:34:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6927  12 59304 66883873 A  ERRORBŸff'
2021-03-31 18:34:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:34:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:34:58 [DEBUG   ] Finished updating board flags in 0.991 seconds
2021-03-31 18:35:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:35:16 [DEBUG   ] Got command BAM from MCS: ref #6928
2021-03-31 18:35:16 [INFO    ] Finished processing BAM request
2021-03-31 18:35:16 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6928   8 59304 66916025 A  ERROR'
2021-03-31 18:35:16 [DEBUG   ] Got command BAM from MCS: ref #6929
2021-03-31 18:35:16 [INFO    ] Finished processing BAM request
2021-03-31 18:35:16 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6929   8 59304 66916029 A  ERROR'
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:35:16 [DEBUG   ] spawn_process: at 2021-03-31 18:35:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:35:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:35:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-03-31 18:35:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 18:35:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:35:59 [DEBUG   ] Finished updating board flags in 1.807 seconds
2021-03-31 18:36:05 [DEBUG   ] Got command BAM from MCS: ref #6931
2021-03-31 18:36:05 [INFO    ] Finished processing BAM request
2021-03-31 18:36:05 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6931   8 59304 66965029 A  ERROR'
2021-03-31 18:36:05 [DEBUG   ] Got command BAM from MCS: ref #6930
2021-03-31 18:36:05 [INFO    ] Finished processing BAM request
2021-03-31 18:36:05 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:36:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6930   8 59304 66965033 A  ERROR'
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:36:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:36:05 [DEBUG   ] spawn_process: at 2021-03-31 18:36:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:36:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 18:36:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:36:54 [DEBUG   ] Got command BAM from MCS: ref #6938
2021-03-31 18:36:54 [INFO    ] Finished processing BAM request
2021-03-31 18:36:54 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6938   8 59304 67014033 A  ERROR'
2021-03-31 18:36:54 [DEBUG   ] Got command BAM from MCS: ref #6939
2021-03-31 18:36:54 [INFO    ] Finished processing BAM request
2021-03-31 18:36:54 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6939   8 59304 67014037 A  ERROR'
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:36:54 [DEBUG   ] spawn_process: at 2021-03-31 18:36:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:36:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:36:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:36:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:36:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:36:58 [DEBUG   ] Finished updating board flags in 1.235 seconds
2021-03-31 18:37:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:37:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:37:43 [DEBUG   ] Got command BAM from MCS: ref #6940
2021-03-31 18:37:43 [INFO    ] Finished processing BAM request
2021-03-31 18:37:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6940   8 59304 67063025 A  ERROR'
2021-03-31 18:37:43 [DEBUG   ] Got command BAM from MCS: ref #6941
2021-03-31 18:37:43 [INFO    ] Finished processing BAM request
2021-03-31 18:37:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:37:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6941   8 59304 67063029 A  ERROR'
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:37:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:37:43 [DEBUG   ] spawn_process: at 2021-03-31 18:37:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:37:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:37:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 18:37:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:37:58 [DEBUG   ] Finished updating board flags in 1.238 seconds
2021-03-31 18:38:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:38:32 [DEBUG   ] Got command BAM from MCS: ref #6942
2021-03-31 18:38:32 [INFO    ] Finished processing BAM request
2021-03-31 18:38:32 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6942   8 59304 67112033 A  ERROR'
2021-03-31 18:38:32 [DEBUG   ] Got command BAM from MCS: ref #6943
2021-03-31 18:38:32 [INFO    ] Finished processing BAM request
2021-03-31 18:38:32 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6943   8 59304 67112037 A  ERROR'
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:38:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:38:32 [DEBUG   ] spawn_process: at 2021-03-31 18:38:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:38:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:38:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:38:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:38:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-03-31 18:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:38:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2021-03-31 18:38:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:38:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:38:58 [DEBUG   ] Finished updating board flags in 1.210 seconds
2021-03-31 18:39:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:39:20 [DEBUG   ] Got command RPT from MCS: ref #6946
2021-03-31 18:39:20 [DEBUG   ] summary = ERROR
2021-03-31 18:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6946  13 59304 67160293 A  ERRORERROR'
2021-03-31 18:39:20 [DEBUG   ] Got command RPT from MCS: ref #6947
2021-03-31 18:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6947  77 59304 67160293 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:39:21 [DEBUG   ] Got command BAM from MCS: ref #6945
2021-03-31 18:39:21 [INFO    ] Finished processing BAM request
2021-03-31 18:39:21 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:39:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6945   8 59304 67161029 A  ERROR'
2021-03-31 18:39:21 [DEBUG   ] Got command BAM from MCS: ref #6944
2021-03-31 18:39:21 [INFO    ] Finished processing BAM request
2021-03-31 18:39:21 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:39:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6944   8 59304 67161033 A  ERROR'
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:39:21 [DEBUG   ] spawn_process: at 2021-03-31 18:39:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:39:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:39:43 [DEBUG   ] Got command RPT from MCS: ref #6968
2021-03-31 18:39:43 [DEBUG   ] summary = ERROR
2021-03-31 18:39:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6968  13 59304 67183137 A  ERRORERROR'
2021-03-31 18:39:43 [DEBUG   ] Got command RPT from MCS: ref #6970
2021-03-31 18:39:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:39:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6970  77 59304 67183341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:39:43 [DEBUG   ] Got command RPT from MCS: ref #6972
2021-03-31 18:39:43 [DEBUG   ] summary = ERROR
2021-03-31 18:39:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6972  13 59304 67183545 A  ERRORERROR'
2021-03-31 18:39:43 [DEBUG   ] Got command RPT from MCS: ref #6974
2021-03-31 18:39:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:39:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6974  77 59304 67183749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:39:43 [DEBUG   ] Got command RPT from MCS: ref #6976
2021-03-31 18:39:43 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:39:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6976  12 59304 67183941 A  ERRORB¢ff'
2021-03-31 18:39:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-03-31 18:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:39:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:39:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:39:58 [DEBUG   ] Finished updating board flags in 1.171 seconds
2021-03-31 18:40:10 [DEBUG   ] Got command BAM from MCS: ref #6981
2021-03-31 18:40:10 [INFO    ] Finished processing BAM request
2021-03-31 18:40:10 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6981   8 59304 67210029 A  ERROR'
2021-03-31 18:40:10 [DEBUG   ] Got command BAM from MCS: ref #6982
2021-03-31 18:40:10 [INFO    ] Finished processing BAM request
2021-03-31 18:40:10 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:40:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6982   8 59304 67210033 A  ERROR'
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:40:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:40:10 [DEBUG   ] spawn_process: at 2021-03-31 18:40:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:40:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 18:40:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 18:40:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 18:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:40:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:40:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:40:58 [DEBUG   ] Finished updating board flags in 1.011 seconds
2021-03-31 18:40:59 [DEBUG   ] Got command BAM from MCS: ref #6983
2021-03-31 18:40:59 [INFO    ] Finished processing BAM request
2021-03-31 18:40:59 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:40:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6983   8 59304 67259029 A  ERROR'
2021-03-31 18:40:59 [DEBUG   ] Got command BAM from MCS: ref #6984
2021-03-31 18:40:59 [INFO    ] Finished processing BAM request
2021-03-31 18:40:59 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:40:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6984   8 59304 67259033 A  ERROR'
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:40:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:40:59 [DEBUG   ] spawn_process: at 2021-03-31 18:40:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:41:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 18:41:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 18:41:48 [DEBUG   ] Got command BAM from MCS: ref #6986
2021-03-31 18:41:48 [INFO    ] Finished processing BAM request
2021-03-31 18:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6986   8 59304 67308033 A  ERROR'
2021-03-31 18:41:48 [DEBUG   ] Got command BAM from MCS: ref #6985
2021-03-31 18:41:48 [INFO    ] Finished processing BAM request
2021-03-31 18:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6985   8 59304 67308037 A  ERROR'
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:41:48 [DEBUG   ] spawn_process: at 2021-03-31 18:41:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:41:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 18:41:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:41:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:41:58 [DEBUG   ] Finished updating board flags in 0.986 seconds
2021-03-31 18:42:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 18:42:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 18:42:37 [DEBUG   ] Got command BAM from MCS: ref #6988
2021-03-31 18:42:37 [INFO    ] Finished processing BAM request
2021-03-31 18:42:37 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6988   8 59304 67357029 A  ERROR'
2021-03-31 18:42:37 [DEBUG   ] Got command BAM from MCS: ref #6987
2021-03-31 18:42:37 [INFO    ] Finished processing BAM request
2021-03-31 18:42:37 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:42:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6987   8 59304 67357033 A  ERROR'
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:42:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:42:37 [DEBUG   ] spawn_process: at 2021-03-31 18:42:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:42:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 18:42:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-03-31 18:42:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-03-31 18:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:42:59 [DEBUG   ] Finished updating board flags in 1.370 seconds
2021-03-31 18:43:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 18:43:26 [DEBUG   ] Got command BAM from MCS: ref #6996
2021-03-31 18:43:26 [INFO    ] Finished processing BAM request
2021-03-31 18:43:26 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6996   8 59304 67406033 A  ERROR'
2021-03-31 18:43:26 [DEBUG   ] Got command BAM from MCS: ref #6995
2021-03-31 18:43:26 [INFO    ] Finished processing BAM request
2021-03-31 18:43:26 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6995   8 59304 67406037 A  ERROR'
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:43:26 [DEBUG   ] spawn_process: at 2021-03-31 18:43:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:43:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:43:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-03-31 18:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:43:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:43:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:43:59 [DEBUG   ] Finished updating board flags in 1.208 seconds
2021-03-31 18:44:15 [DEBUG   ] Got command BAM from MCS: ref #6998
2021-03-31 18:44:15 [INFO    ] Finished processing BAM request
2021-03-31 18:44:15 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6998   8 59304 67455025 A  ERROR'
2021-03-31 18:44:15 [DEBUG   ] Got command BAM from MCS: ref #6997
2021-03-31 18:44:15 [INFO    ] Finished processing BAM request
2021-03-31 18:44:15 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6997   8 59304 67455029 A  ERROR'
2021-03-31 18:44:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:44:15 [DEBUG   ] spawn_process: at 2021-03-31 18:44:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:44:20 [DEBUG   ] Got command RPT from MCS: ref #6999
2021-03-31 18:44:20 [DEBUG   ] summary = ERROR
2021-03-31 18:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6999  13 59304 67460297 A  ERRORERROR'
2021-03-31 18:44:20 [DEBUG   ] Got command RPT from MCS: ref #7000
2021-03-31 18:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7000  77 59304 67460297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:44:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 18:44:43 [DEBUG   ] Got command RPT from MCS: ref #7016
2021-03-31 18:44:43 [DEBUG   ] summary = ERROR
2021-03-31 18:44:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7016  13 59304 67483217 A  ERRORERROR'
2021-03-31 18:44:43 [DEBUG   ] Got command RPT from MCS: ref #7017
2021-03-31 18:44:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:44:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7017  77 59304 67483421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:44:43 [DEBUG   ] Got command RPT from MCS: ref #7018
2021-03-31 18:44:43 [DEBUG   ] summary = ERROR
2021-03-31 18:44:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7018  13 59304 67483613 A  ERRORERROR'
2021-03-31 18:44:43 [DEBUG   ] Got command RPT from MCS: ref #7019
2021-03-31 18:44:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:44:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7019  77 59304 67483817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:44:44 [DEBUG   ] Got command RPT from MCS: ref #7020
2021-03-31 18:44:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7020  12 59304 67484021 A  ERRORB£ff'
2021-03-31 18:44:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 18:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:44:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-03-31 18:44:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-03-31 18:44:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:44:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:44:59 [DEBUG   ] Finished updating board flags in 1.228 seconds
2021-03-31 18:45:04 [DEBUG   ] Got command BAM from MCS: ref #7021
2021-03-31 18:45:04 [INFO    ] Finished processing BAM request
2021-03-31 18:45:04 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7021   8 59304 67504033 A  ERROR'
2021-03-31 18:45:04 [DEBUG   ] Got command BAM from MCS: ref #7022
2021-03-31 18:45:04 [INFO    ] Finished processing BAM request
2021-03-31 18:45:04 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:45:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7022   8 59304 67504037 A  ERROR'
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:45:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:45:04 [DEBUG   ] spawn_process: at 2021-03-31 18:45:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:45:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:45:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:45:53 [DEBUG   ] Got command BAM from MCS: ref #7029
2021-03-31 18:45:53 [INFO    ] Finished processing BAM request
2021-03-31 18:45:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:45:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7029   8 59304 67553033 A  ERROR'
2021-03-31 18:45:53 [DEBUG   ] Got command BAM from MCS: ref #7030
2021-03-31 18:45:53 [INFO    ] Finished processing BAM request
2021-03-31 18:45:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:45:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7030   8 59304 67553037 A  ERROR'
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:45:53 [DEBUG   ] spawn_process: at 2021-03-31 18:45:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:45:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-03-31 18:45:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:45:59 [DEBUG   ] Finished updating board flags in 1.204 seconds
2021-03-31 18:46:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:46:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:46:42 [DEBUG   ] Got command BAM from MCS: ref #7031
2021-03-31 18:46:42 [INFO    ] Finished processing BAM request
2021-03-31 18:46:42 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7031   8 59304 67602025 A  ERROR'
2021-03-31 18:46:42 [DEBUG   ] Got command BAM from MCS: ref #7032
2021-03-31 18:46:42 [INFO    ] Finished processing BAM request
2021-03-31 18:46:42 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7032   8 59304 67602029 A  ERROR'
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:46:42 [DEBUG   ] spawn_process: at 2021-03-31 18:46:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:46:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:46:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:46:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 18:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:46:59 [DEBUG   ] Finished updating board flags in 1.190 seconds
2021-03-31 18:47:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:47:31 [DEBUG   ] Got command BAM from MCS: ref #7034
2021-03-31 18:47:31 [INFO    ] Finished processing BAM request
2021-03-31 18:47:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7034   8 59304 67651029 A  ERROR'
2021-03-31 18:47:31 [DEBUG   ] Got command BAM from MCS: ref #7033
2021-03-31 18:47:31 [INFO    ] Finished processing BAM request
2021-03-31 18:47:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:47:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7033   8 59304 67651033 A  ERROR'
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:47:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:47:31 [DEBUG   ] spawn_process: at 2021-03-31 18:47:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:47:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:47:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:48:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:48:00 [DEBUG   ] Finished updating board flags in 2.019 seconds
2021-03-31 18:48:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:48:20 [DEBUG   ] Got command BAM from MCS: ref #7036
2021-03-31 18:48:20 [INFO    ] Finished processing BAM request
2021-03-31 18:48:20 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7036   8 59304 67700033 A  ERROR'
2021-03-31 18:48:20 [DEBUG   ] Got command BAM from MCS: ref #7035
2021-03-31 18:48:20 [INFO    ] Finished processing BAM request
2021-03-31 18:48:20 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7035   8 59304 67700037 A  ERROR'
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:48:20 [DEBUG   ] spawn_process: at 2021-03-31 18:48:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:48:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:48:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 18:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 18:49:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:49:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:49:00 [DEBUG   ] Finished updating board flags in 1.967 seconds
2021-03-31 18:49:09 [DEBUG   ] Got command BAM from MCS: ref #7043
2021-03-31 18:49:09 [INFO    ] Finished processing BAM request
2021-03-31 18:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7043   8 59304 67749025 A  ERROR'
2021-03-31 18:49:09 [DEBUG   ] Got command BAM from MCS: ref #7044
2021-03-31 18:49:09 [INFO    ] Finished processing BAM request
2021-03-31 18:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7044   8 59304 67749029 A  ERROR'
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:49:09 [DEBUG   ] spawn_process: at 2021-03-31 18:49:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:49:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 18:49:20 [DEBUG   ] Got command RPT from MCS: ref #7045
2021-03-31 18:49:20 [DEBUG   ] summary = ERROR
2021-03-31 18:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7045  13 59304 67760297 A  ERRORERROR'
2021-03-31 18:49:20 [DEBUG   ] Got command RPT from MCS: ref #7046
2021-03-31 18:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7046  77 59304 67760297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:49:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:49:43 [DEBUG   ] Got command RPT from MCS: ref #7064
2021-03-31 18:49:43 [DEBUG   ] summary = ERROR
2021-03-31 18:49:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7064  13 59304 67783289 A  ERRORERROR'
2021-03-31 18:49:43 [DEBUG   ] Got command RPT from MCS: ref #7065
2021-03-31 18:49:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:49:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7065  77 59304 67783493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:49:43 [DEBUG   ] Got command RPT from MCS: ref #7066
2021-03-31 18:49:43 [DEBUG   ] summary = ERROR
2021-03-31 18:49:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7066  13 59304 67783685 A  ERRORERROR'
2021-03-31 18:49:43 [DEBUG   ] Got command RPT from MCS: ref #7067
2021-03-31 18:49:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:49:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7067  77 59304 67783893 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:49:44 [DEBUG   ] Got command RPT from MCS: ref #7069
2021-03-31 18:49:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7069  12 59304 67784104 A  ERRORB¢ff'
2021-03-31 18:49:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:49:58 [DEBUG   ] Got command BAM from MCS: ref #7074
2021-03-31 18:49:58 [INFO    ] Finished processing BAM request
2021-03-31 18:49:58 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7074   8 59304 67798025 A  ERROR'
2021-03-31 18:49:58 [DEBUG   ] Got command BAM from MCS: ref #7075
2021-03-31 18:49:58 [INFO    ] Finished processing BAM request
2021-03-31 18:49:58 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7075   8 59304 67798029 A  ERROR'
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:49:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:49:58 [DEBUG   ] spawn_process: at 2021-03-31 18:49:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:49:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 18:49:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 18:49:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:49:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:49:59 [DEBUG   ] Finished updating board flags in 1.227 seconds
2021-03-31 18:50:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:50:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:50:47 [DEBUG   ] Got command BAM from MCS: ref #7077
2021-03-31 18:50:47 [INFO    ] Finished processing BAM request
2021-03-31 18:50:47 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:50:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7077   8 59304 67847033 A  ERROR'
2021-03-31 18:50:47 [DEBUG   ] Got command BAM from MCS: ref #7076
2021-03-31 18:50:47 [INFO    ] Finished processing BAM request
2021-03-31 18:50:47 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:50:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7076   8 59304 67847037 A  ERROR'
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:50:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:50:47 [DEBUG   ] spawn_process: at 2021-03-31 18:50:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:50:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 18:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:50:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:50:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:50:59 [DEBUG   ] Finished updating board flags in 1.218 seconds
2021-03-31 18:51:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:51:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:51:36 [DEBUG   ] Got command BAM from MCS: ref #7079
2021-03-31 18:51:36 [INFO    ] Finished processing BAM request
2021-03-31 18:51:36 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7079   8 59304 67896029 A  ERROR'
2021-03-31 18:51:36 [DEBUG   ] Got command BAM from MCS: ref #7078
2021-03-31 18:51:36 [INFO    ] Finished processing BAM request
2021-03-31 18:51:36 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7078   8 59304 67896033 A  ERROR'
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:51:36 [DEBUG   ] spawn_process: at 2021-03-31 18:51:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:51:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:51:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:51:59 [DEBUG   ] Finished updating board flags in 1.220 seconds
2021-03-31 18:52:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:52:25 [DEBUG   ] Got command BAM from MCS: ref #7086
2021-03-31 18:52:25 [INFO    ] Finished processing BAM request
2021-03-31 18:52:25 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7086   8 59304 67945033 A  ERROR'
2021-03-31 18:52:25 [DEBUG   ] Got command BAM from MCS: ref #7087
2021-03-31 18:52:25 [INFO    ] Finished processing BAM request
2021-03-31 18:52:25 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7087   8 59304 67945037 A  ERROR'
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:52:25 [DEBUG   ] spawn_process: at 2021-03-31 18:52:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:52:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:52:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:52:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 18:52:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:52:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:52:59 [DEBUG   ] Finished updating board flags in 1.183 seconds
2021-03-31 18:53:14 [DEBUG   ] Got command BAM from MCS: ref #7088
2021-03-31 18:53:14 [INFO    ] Finished processing BAM request
2021-03-31 18:53:14 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7088   8 59304 67994029 A  ERROR'
2021-03-31 18:53:14 [DEBUG   ] Got command BAM from MCS: ref #7089
2021-03-31 18:53:14 [INFO    ] Finished processing BAM request
2021-03-31 18:53:14 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:53:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7089   8 59304 67994033 A  ERROR'
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:53:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:53:14 [DEBUG   ] spawn_process: at 2021-03-31 18:53:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:53:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 18:53:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:53:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 18:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2021-03-31 18:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:54:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:54:00 [DEBUG   ] Finished updating board flags in 1.615 seconds
2021-03-31 18:54:03 [DEBUG   ] Got command BAM from MCS: ref #7090
2021-03-31 18:54:03 [INFO    ] Finished processing BAM request
2021-03-31 18:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7090   8 59304 68043033 A  ERROR'
2021-03-31 18:54:03 [DEBUG   ] Got command BAM from MCS: ref #7091
2021-03-31 18:54:03 [INFO    ] Finished processing BAM request
2021-03-31 18:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7091   8 59304 68043037 A  ERROR'
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:54:03 [DEBUG   ] spawn_process: at 2021-03-31 18:54:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:54:15 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-03-31 18:54:20 [DEBUG   ] Got command RPT from MCS: ref #7092
2021-03-31 18:54:20 [DEBUG   ] summary = ERROR
2021-03-31 18:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7092  13 59304 68060297 A  ERRORERROR'
2021-03-31 18:54:20 [DEBUG   ] Got command RPT from MCS: ref #7093
2021-03-31 18:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7093  77 59304 68060297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:54:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 18:54:43 [DEBUG   ] Got command RPT from MCS: ref #7112
2021-03-31 18:54:43 [DEBUG   ] summary = ERROR
2021-03-31 18:54:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7112  13 59304 68083353 A  ERRORERROR'
2021-03-31 18:54:43 [DEBUG   ] Got command RPT from MCS: ref #7114
2021-03-31 18:54:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:54:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7114  77 59304 68083557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:54:43 [DEBUG   ] Got command RPT from MCS: ref #7116
2021-03-31 18:54:43 [DEBUG   ] summary = ERROR
2021-03-31 18:54:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7116  13 59304 68083761 A  ERRORERROR'
2021-03-31 18:54:43 [DEBUG   ] Got command RPT from MCS: ref #7118
2021-03-31 18:54:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:54:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7118  77 59304 68083965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:54:44 [DEBUG   ] Got command RPT from MCS: ref #7119
2021-03-31 18:54:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7119  12 59304 68084157 A  ERRORB¢ff'
2021-03-31 18:54:52 [DEBUG   ] Got command BAM from MCS: ref #7120
2021-03-31 18:54:52 [INFO    ] Finished processing BAM request
2021-03-31 18:54:52 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7120   8 59304 68092033 A  ERROR'
2021-03-31 18:54:52 [DEBUG   ] Got command BAM from MCS: ref #7121
2021-03-31 18:54:52 [INFO    ] Finished processing BAM request
2021-03-31 18:54:52 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7121   8 59304 68092037 A  ERROR'
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 18:54:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 18:54:52 [DEBUG   ] spawn_process: at 2021-03-31 18:54:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 18:54:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 18:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:54:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:54:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:54:59 [DEBUG   ] Finished updating board flags in 0.972 seconds
2021-03-31 18:55:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:55:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:55:41 [DEBUG   ] Got command BAM from MCS: ref #7122
2021-03-31 18:55:41 [INFO    ] Finished processing BAM request
2021-03-31 18:55:41 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:55:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7122   8 59304 68141025 A  ERROR'
2021-03-31 18:55:41 [DEBUG   ] Got command BAM from MCS: ref #7123
2021-03-31 18:55:41 [INFO    ] Finished processing BAM request
2021-03-31 18:55:41 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:55:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7123   8 59304 68141029 A  ERROR'
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 18:55:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 18:55:41 [DEBUG   ] spawn_process: at 2021-03-31 18:55:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 18:55:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:56:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:56:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:56:00 [DEBUG   ] Finished updating board flags in 1.372 seconds
2021-03-31 18:56:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:56:30 [DEBUG   ] Got command BAM from MCS: ref #7125
2021-03-31 18:56:30 [INFO    ] Finished processing BAM request
2021-03-31 18:56:30 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7125   8 59304 68190029 A  ERROR'
2021-03-31 18:56:30 [DEBUG   ] Got command BAM from MCS: ref #7124
2021-03-31 18:56:30 [INFO    ] Finished processing BAM request
2021-03-31 18:56:30 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7124   8 59304 68190033 A  ERROR'
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:56:30 [DEBUG   ] spawn_process: at 2021-03-31 18:56:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:56:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:56:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:57:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 18:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:57:00 [DEBUG   ] Finished updating board flags in 1.206 seconds
2021-03-31 18:57:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:57:19 [DEBUG   ] Got command BAM from MCS: ref #7126
2021-03-31 18:57:19 [INFO    ] Finished processing BAM request
2021-03-31 18:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7126   8 59304 68239033 A  ERROR'
2021-03-31 18:57:19 [DEBUG   ] Got command BAM from MCS: ref #7127
2021-03-31 18:57:19 [INFO    ] Finished processing BAM request
2021-03-31 18:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7127   8 59304 68239037 A  ERROR'
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:57:19 [DEBUG   ] spawn_process: at 2021-03-31 18:57:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:57:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:57:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:58:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:58:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:58:00 [DEBUG   ] Finished updating board flags in 1.194 seconds
2021-03-31 18:58:08 [DEBUG   ] Got command BAM from MCS: ref #7135
2021-03-31 18:58:08 [INFO    ] Finished processing BAM request
2021-03-31 18:58:08 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7135   8 59304 68288025 A  ERROR'
2021-03-31 18:58:08 [DEBUG   ] Got command BAM from MCS: ref #7134
2021-03-31 18:58:08 [INFO    ] Finished processing BAM request
2021-03-31 18:58:08 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7134   8 59304 68288029 A  ERROR'
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 18:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 18:58:08 [DEBUG   ] spawn_process: at 2021-03-31 18:58:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 18:58:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:58:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:58:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:58:57 [DEBUG   ] Got command BAM from MCS: ref #7137
2021-03-31 18:58:57 [INFO    ] Finished processing BAM request
2021-03-31 18:58:57 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7137   8 59304 68337025 A  ERROR'
2021-03-31 18:58:57 [DEBUG   ] Got command BAM from MCS: ref #7136
2021-03-31 18:58:57 [INFO    ] Finished processing BAM request
2021-03-31 18:58:57 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7136   8 59304 68337029 A  ERROR'
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 18:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 18:58:57 [DEBUG   ] spawn_process: at 2021-03-31 18:58:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 18:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 18:59:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 18:59:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 18:59:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 18:59:00 [DEBUG   ] Finished updating board flags in 1.013 seconds
2021-03-31 18:59:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:59:20 [DEBUG   ] Got command RPT from MCS: ref #7138
2021-03-31 18:59:20 [DEBUG   ] summary = ERROR
2021-03-31 18:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7138  13 59304 68360297 A  ERRORERROR'
2021-03-31 18:59:20 [DEBUG   ] Got command RPT from MCS: ref #7139
2021-03-31 18:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7139  77 59304 68360297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:59:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 18:59:43 [DEBUG   ] Got command RPT from MCS: ref #7157
2021-03-31 18:59:43 [DEBUG   ] summary = ERROR
2021-03-31 18:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7157  13 59304 68383429 A  ERRORERROR'
2021-03-31 18:59:43 [DEBUG   ] Got command RPT from MCS: ref #7158
2021-03-31 18:59:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7158  77 59304 68383633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:59:43 [DEBUG   ] Got command RPT from MCS: ref #7159
2021-03-31 18:59:43 [DEBUG   ] summary = ERROR
2021-03-31 18:59:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7159  13 59304 68383837 A  ERRORERROR'
2021-03-31 18:59:44 [DEBUG   ] Got command RPT from MCS: ref #7160
2021-03-31 18:59:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 18:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7160  77 59304 68384029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 18:59:44 [DEBUG   ] Got command RPT from MCS: ref #7162
2021-03-31 18:59:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 18:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7162  12 59304 68384233 A  ERRORB¡ff'
2021-03-31 18:59:46 [DEBUG   ] Got command BAM from MCS: ref #7167
2021-03-31 18:59:46 [INFO    ] Finished processing BAM request
2021-03-31 18:59:46 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7167   8 59304 68386025 A  ERROR'
2021-03-31 18:59:46 [DEBUG   ] Got command BAM from MCS: ref #7166
2021-03-31 18:59:46 [INFO    ] Finished processing BAM request
2021-03-31 18:59:46 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 18:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7166   8 59304 68386029 A  ERROR'
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 18:59:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 18:59:46 [DEBUG   ] spawn_process: at 2021-03-31 18:59:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 18:59:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 18:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 19:00:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:00:00 [DEBUG   ] Finished updating board flags in 0.996 seconds
2021-03-31 19:00:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:00:35 [DEBUG   ] Got command BAM from MCS: ref #7169
2021-03-31 19:00:35 [INFO    ] Finished processing BAM request
2021-03-31 19:00:35 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7169   8 59304 68435025 A  ERROR'
2021-03-31 19:00:35 [DEBUG   ] Got command BAM from MCS: ref #7170
2021-03-31 19:00:35 [INFO    ] Finished processing BAM request
2021-03-31 19:00:35 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7170   8 59304 68435029 A  ERROR'
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:00:35 [DEBUG   ] spawn_process: at 2021-03-31 19:00:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:00:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:00:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:01:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:01:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:01:01 [DEBUG   ] Finished updating board flags in 1.818 seconds
2021-03-31 19:01:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:01:24 [DEBUG   ] Got command BAM from MCS: ref #7177
2021-03-31 19:01:24 [INFO    ] Finished processing BAM request
2021-03-31 19:01:24 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7177   8 59304 68484033 A  ERROR'
2021-03-31 19:01:24 [DEBUG   ] Got command BAM from MCS: ref #7178
2021-03-31 19:01:24 [INFO    ] Finished processing BAM request
2021-03-31 19:01:24 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7178   8 59304 68484037 A  ERROR'
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 19:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 19:01:24 [DEBUG   ] spawn_process: at 2021-03-31 19:01:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 19:01:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:01:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:02:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:02:00 [DEBUG   ] Finished updating board flags in 1.288 seconds
2021-03-31 19:02:13 [DEBUG   ] Got command BAM from MCS: ref #7180
2021-03-31 19:02:13 [INFO    ] Finished processing BAM request
2021-03-31 19:02:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7180   8 59304 68533025 A  ERROR'
2021-03-31 19:02:13 [DEBUG   ] Got command BAM from MCS: ref #7179
2021-03-31 19:02:13 [INFO    ] Finished processing BAM request
2021-03-31 19:02:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:02:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7179   8 59304 68533029 A  ERROR'
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:02:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:02:13 [DEBUG   ] spawn_process: at 2021-03-31 19:02:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:02:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 19:02:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:02:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:03:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:03:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:03:00 [DEBUG   ] Finished updating board flags in 1.147 seconds
2021-03-31 19:03:02 [DEBUG   ] Got command BAM from MCS: ref #7182
2021-03-31 19:03:02 [INFO    ] Finished processing BAM request
2021-03-31 19:03:02 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:03:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7182   8 59304 68582033 A  ERROR'
2021-03-31 19:03:02 [DEBUG   ] Got command BAM from MCS: ref #7181
2021-03-31 19:03:02 [INFO    ] Finished processing BAM request
2021-03-31 19:03:02 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:03:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7181   8 59304 68582037 A  ERROR'
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:03:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:03:02 [DEBUG   ] spawn_process: at 2021-03-31 19:03:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:03:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:03:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:03:51 [DEBUG   ] Got command BAM from MCS: ref #7189
2021-03-31 19:03:51 [INFO    ] Finished processing BAM request
2021-03-31 19:03:51 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7189   8 59304 68631033 A  ERROR'
2021-03-31 19:03:51 [DEBUG   ] Got command BAM from MCS: ref #7190
2021-03-31 19:03:51 [INFO    ] Finished processing BAM request
2021-03-31 19:03:51 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7190   8 59304 68631037 A  ERROR'
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:03:51 [DEBUG   ] spawn_process: at 2021-03-31 19:03:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:03:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:04:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:04:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:04:00 [DEBUG   ] Finished updating board flags in 1.013 seconds
2021-03-31 19:04:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:04:20 [DEBUG   ] Got command RPT from MCS: ref #7191
2021-03-31 19:04:20 [DEBUG   ] summary = ERROR
2021-03-31 19:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7191  13 59304 68660309 A  ERRORERROR'
2021-03-31 19:04:20 [DEBUG   ] Got command RPT from MCS: ref #7192
2021-03-31 19:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7192  77 59304 68660309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:04:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:04:40 [DEBUG   ] Got command BAM from MCS: ref #7208
2021-03-31 19:04:40 [INFO    ] Finished processing BAM request
2021-03-31 19:04:40 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7208   8 59304 68680029 A  ERROR'
2021-03-31 19:04:40 [DEBUG   ] Got command BAM from MCS: ref #7209
2021-03-31 19:04:40 [INFO    ] Finished processing BAM request
2021-03-31 19:04:40 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:04:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7209   8 59304 68680033 A  ERROR'
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:04:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:04:40 [DEBUG   ] spawn_process: at 2021-03-31 19:04:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:04:43 [DEBUG   ] Got command RPT from MCS: ref #7210
2021-03-31 19:04:43 [DEBUG   ] summary = ERROR
2021-03-31 19:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7210  13 59304 68683501 A  ERRORERROR'
2021-03-31 19:04:43 [DEBUG   ] Got command RPT from MCS: ref #7211
2021-03-31 19:04:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7211  77 59304 68683705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:04:43 [DEBUG   ] Got command RPT from MCS: ref #7212
2021-03-31 19:04:43 [DEBUG   ] summary = ERROR
2021-03-31 19:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7212  13 59304 68683897 A  ERRORERROR'
2021-03-31 19:04:44 [DEBUG   ] Got command RPT from MCS: ref #7213
2021-03-31 19:04:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7213  77 59304 68684101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:04:44 [DEBUG   ] Got command RPT from MCS: ref #7214
2021-03-31 19:04:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7214  12 59304 68684305 A  ERRORB¡ff'
2021-03-31 19:04:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:05:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:05:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:05:00 [DEBUG   ] Finished updating board flags in 1.035 seconds
2021-03-31 19:05:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:05:29 [DEBUG   ] Got command BAM from MCS: ref #7215
2021-03-31 19:05:29 [INFO    ] Finished processing BAM request
2021-03-31 19:05:29 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7215   8 59304 68729029 A  ERROR'
2021-03-31 19:05:29 [DEBUG   ] Got command BAM from MCS: ref #7216
2021-03-31 19:05:29 [INFO    ] Finished processing BAM request
2021-03-31 19:05:29 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7216   8 59304 68729033 A  ERROR'
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:05:29 [DEBUG   ] spawn_process: at 2021-03-31 19:05:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:05:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:05:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:06:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:06:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:06:00 [DEBUG   ] Finished updating board flags in 0.979 seconds
2021-03-31 19:06:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:06:18 [DEBUG   ] Got command BAM from MCS: ref #7217
2021-03-31 19:06:18 [INFO    ] Finished processing BAM request
2021-03-31 19:06:18 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7217   8 59304 68778029 A  ERROR'
2021-03-31 19:06:18 [DEBUG   ] Got command BAM from MCS: ref #7218
2021-03-31 19:06:18 [INFO    ] Finished processing BAM request
2021-03-31 19:06:18 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7218   8 59304 68778033 A  ERROR'
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:06:18 [DEBUG   ] spawn_process: at 2021-03-31 19:06:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:06:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:06:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:07:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:07:01 [DEBUG   ] Finished updating board flags in 1.339 seconds
2021-03-31 19:07:07 [DEBUG   ] Got command BAM from MCS: ref #7225
2021-03-31 19:07:07 [INFO    ] Finished processing BAM request
2021-03-31 19:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7225   8 59304 68827029 A  ERROR'
2021-03-31 19:07:07 [DEBUG   ] Got command BAM from MCS: ref #7226
2021-03-31 19:07:07 [INFO    ] Finished processing BAM request
2021-03-31 19:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7226   8 59304 68827033 A  ERROR'
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:07:07 [DEBUG   ] spawn_process: at 2021-03-31 19:07:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:07:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:07:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:07:56 [DEBUG   ] Got command BAM from MCS: ref #7227
2021-03-31 19:07:56 [INFO    ] Finished processing BAM request
2021-03-31 19:07:56 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:07:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7227   8 59304 68876025 A  ERROR'
2021-03-31 19:07:56 [DEBUG   ] Got command BAM from MCS: ref #7228
2021-03-31 19:07:56 [INFO    ] Finished processing BAM request
2021-03-31 19:07:56 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:07:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7228   8 59304 68876029 A  ERROR'
2021-03-31 19:07:56 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:07:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:07:56 [DEBUG   ] spawn_process: at 2021-03-31 19:07:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:08:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:08:01 [DEBUG   ] Finished updating board flags in 1.210 seconds
2021-03-31 19:08:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:08:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:08:45 [DEBUG   ] Got command BAM from MCS: ref #7229
2021-03-31 19:08:45 [INFO    ] Finished processing BAM request
2021-03-31 19:08:45 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7229   8 59304 68925025 A  ERROR'
2021-03-31 19:08:45 [DEBUG   ] Got command BAM from MCS: ref #7230
2021-03-31 19:08:45 [INFO    ] Finished processing BAM request
2021-03-31 19:08:45 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7230   8 59304 68925029 A  ERROR'
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:08:45 [DEBUG   ] spawn_process: at 2021-03-31 19:08:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:08:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 19:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:09:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:09:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:09:01 [DEBUG   ] Finished updating board flags in 1.195 seconds
2021-03-31 19:09:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:09:20 [DEBUG   ] Got command RPT from MCS: ref #7231
2021-03-31 19:09:20 [DEBUG   ] summary = ERROR
2021-03-31 19:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7231  13 59304 68960301 A  ERRORERROR'
2021-03-31 19:09:20 [DEBUG   ] Got command RPT from MCS: ref #7232
2021-03-31 19:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7232  77 59304 68960301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:09:34 [DEBUG   ] Got command BAM from MCS: ref #7248
2021-03-31 19:09:34 [INFO    ] Finished processing BAM request
2021-03-31 19:09:34 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:09:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7248   8 59304 68974029 A  ERROR'
2021-03-31 19:09:34 [DEBUG   ] Got command BAM from MCS: ref #7249
2021-03-31 19:09:34 [INFO    ] Finished processing BAM request
2021-03-31 19:09:34 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:09:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7249   8 59304 68974033 A  ERROR'
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:09:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:09:34 [DEBUG   ] spawn_process: at 2021-03-31 19:09:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:09:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:09:43 [DEBUG   ] Got command RPT from MCS: ref #7255
2021-03-31 19:09:43 [DEBUG   ] summary = ERROR
2021-03-31 19:09:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7255  13 59304 68983569 A  ERRORERROR'
2021-03-31 19:09:43 [DEBUG   ] Got command RPT from MCS: ref #7257
2021-03-31 19:09:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:09:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7257  77 59304 68983773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:09:43 [DEBUG   ] Got command RPT from MCS: ref #7259
2021-03-31 19:09:43 [DEBUG   ] summary = ERROR
2021-03-31 19:09:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7259  13 59304 68983977 A  ERRORERROR'
2021-03-31 19:09:44 [DEBUG   ] Got command RPT from MCS: ref #7261
2021-03-31 19:09:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:09:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7261  77 59304 68984169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:09:44 [DEBUG   ] Got command RPT from MCS: ref #7263
2021-03-31 19:09:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:09:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7263  12 59304 68984373 A  ERRORB ff'
2021-03-31 19:09:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 19:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:10:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:10:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:10:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:10:01 [DEBUG   ] Finished updating board flags in 1.041 seconds
2021-03-31 19:10:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 19:10:23 [DEBUG   ] Got command BAM from MCS: ref #7268
2021-03-31 19:10:23 [INFO    ] Finished processing BAM request
2021-03-31 19:10:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:10:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7268   8 59304 69023025 A  ERROR'
2021-03-31 19:10:23 [DEBUG   ] Got command BAM from MCS: ref #7269
2021-03-31 19:10:23 [INFO    ] Finished processing BAM request
2021-03-31 19:10:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:10:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7269   8 59304 69023029 A  ERROR'
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:10:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:10:23 [DEBUG   ] spawn_process: at 2021-03-31 19:10:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:10:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:10:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:11:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-03-31 19:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:11:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:11:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:11:02 [DEBUG   ] Finished updating board flags in 1.997 seconds
2021-03-31 19:11:12 [DEBUG   ] Got command BAM from MCS: ref #7270
2021-03-31 19:11:12 [INFO    ] Finished processing BAM request
2021-03-31 19:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7270   8 59304 69072029 A  ERROR'
2021-03-31 19:11:12 [DEBUG   ] Got command BAM from MCS: ref #7271
2021-03-31 19:11:12 [INFO    ] Finished processing BAM request
2021-03-31 19:11:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:11:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7271   8 59304 69072033 A  ERROR'
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:11:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:11:12 [DEBUG   ] spawn_process: at 2021-03-31 19:11:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:11:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:11:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:11:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:12:01 [DEBUG   ] Got command BAM from MCS: ref #7273
2021-03-31 19:12:01 [INFO    ] Finished processing BAM request
2021-03-31 19:12:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7273   8 59304 69121033 A  ERROR'
2021-03-31 19:12:01 [DEBUG   ] Got command BAM from MCS: ref #7272
2021-03-31 19:12:01 [INFO    ] Finished processing BAM request
2021-03-31 19:12:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7272   8 59304 69121037 A  ERROR'
2021-03-31 19:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:12:01 [DEBUG   ] spawn_process: at 2021-03-31 19:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:12:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:12:02 [DEBUG   ] Finished updating board flags in 1.815 seconds
2021-03-31 19:12:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:12:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:12:50 [DEBUG   ] Got command BAM from MCS: ref #7280
2021-03-31 19:12:50 [INFO    ] Finished processing BAM request
2021-03-31 19:12:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:12:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7280   8 59304 69170033 A  ERROR'
2021-03-31 19:12:50 [DEBUG   ] Got command BAM from MCS: ref #7281
2021-03-31 19:12:50 [INFO    ] Finished processing BAM request
2021-03-31 19:12:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:12:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7281   8 59304 69170037 A  ERROR'
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:12:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:12:50 [DEBUG   ] spawn_process: at 2021-03-31 19:12:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:12:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:13:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:13:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:13:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:13:01 [DEBUG   ] Finished updating board flags in 1.201 seconds
2021-03-31 19:13:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:13:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:13:39 [DEBUG   ] Got command BAM from MCS: ref #7283
2021-03-31 19:13:39 [INFO    ] Finished processing BAM request
2021-03-31 19:13:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7283   8 59304 69219029 A  ERROR'
2021-03-31 19:13:39 [DEBUG   ] Got command BAM from MCS: ref #7282
2021-03-31 19:13:39 [INFO    ] Finished processing BAM request
2021-03-31 19:13:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7282   8 59304 69219033 A  ERROR'
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:13:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:13:39 [DEBUG   ] spawn_process: at 2021-03-31 19:13:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:13:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:14:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:14:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:14:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:14:01 [DEBUG   ] Finished updating board flags in 1.222 seconds
2021-03-31 19:14:16 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-03-31 19:14:20 [DEBUG   ] Got command RPT from MCS: ref #7284
2021-03-31 19:14:20 [DEBUG   ] summary = ERROR
2021-03-31 19:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7284  13 59304 69260305 A  ERRORERROR'
2021-03-31 19:14:20 [DEBUG   ] Got command RPT from MCS: ref #7285
2021-03-31 19:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7285  77 59304 69260305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:14:28 [DEBUG   ] Got command BAM from MCS: ref #7302
2021-03-31 19:14:28 [INFO    ] Finished processing BAM request
2021-03-31 19:14:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7302   8 59304 69268025 A  ERROR'
2021-03-31 19:14:28 [DEBUG   ] Got command BAM from MCS: ref #7301
2021-03-31 19:14:28 [INFO    ] Finished processing BAM request
2021-03-31 19:14:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7301   8 59304 69268029 A  ERROR'
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 19:14:28 [DEBUG   ] spawn_process: at 2021-03-31 19:14:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 19:14:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:14:43 [DEBUG   ] Got command RPT from MCS: ref #7303
2021-03-31 19:14:43 [DEBUG   ] summary = ERROR
2021-03-31 19:14:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7303  13 59304 69283645 A  ERRORERROR'
2021-03-31 19:14:43 [DEBUG   ] Got command RPT from MCS: ref #7304
2021-03-31 19:14:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:14:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7304  77 59304 69283849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:14:44 [DEBUG   ] Got command RPT from MCS: ref #7305
2021-03-31 19:14:44 [DEBUG   ] summary = ERROR
2021-03-31 19:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7305  13 59304 69284053 A  ERRORERROR'
2021-03-31 19:14:44 [DEBUG   ] Got command RPT from MCS: ref #7306
2021-03-31 19:14:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7306  77 59304 69284245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:14:44 [DEBUG   ] Got command RPT from MCS: ref #7307
2021-03-31 19:14:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7307  12 59304 69284449 A  ERRORB ff'
2021-03-31 19:14:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:15:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:15:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:15:01 [DEBUG   ] Finished updating board flags in 1.189 seconds
2021-03-31 19:15:17 [DEBUG   ] Got command BAM from MCS: ref #7309
2021-03-31 19:15:17 [INFO    ] Finished processing BAM request
2021-03-31 19:15:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7309   8 59304 69317033 A  ERROR'
2021-03-31 19:15:17 [DEBUG   ] Got command BAM from MCS: ref #7308
2021-03-31 19:15:17 [INFO    ] Finished processing BAM request
2021-03-31 19:15:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:15:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7308   8 59304 69317037 A  ERROR'
2021-03-31 19:15:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:15:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:15:17 [DEBUG   ] spawn_process: at 2021-03-31 19:15:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:15:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 19:15:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:16:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:16:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:16:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:16:01 [DEBUG   ] Finished updating board flags in 0.985 seconds
2021-03-31 19:16:06 [DEBUG   ] Got command BAM from MCS: ref #7316
2021-03-31 19:16:06 [INFO    ] Finished processing BAM request
2021-03-31 19:16:06 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7316   8 59304 69366033 A  ERROR'
2021-03-31 19:16:06 [DEBUG   ] Got command BAM from MCS: ref #7317
2021-03-31 19:16:06 [INFO    ] Finished processing BAM request
2021-03-31 19:16:06 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:16:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7317   8 59304 69366037 A  ERROR'
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:16:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:16:06 [DEBUG   ] spawn_process: at 2021-03-31 19:16:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:16:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 19:16:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:16:55 [DEBUG   ] Got command BAM from MCS: ref #7319
2021-03-31 19:16:55 [INFO    ] Finished processing BAM request
2021-03-31 19:16:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7319   8 59304 69415033 A  ERROR'
2021-03-31 19:16:55 [DEBUG   ] Got command BAM from MCS: ref #7318
2021-03-31 19:16:55 [INFO    ] Finished processing BAM request
2021-03-31 19:16:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:16:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7318   8 59304 69415037 A  ERROR'
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:16:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:16:55 [DEBUG   ] spawn_process: at 2021-03-31 19:16:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:16:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:17:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:17:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:17:02 [DEBUG   ] Finished updating board flags in 1.384 seconds
2021-03-31 19:17:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 19:17:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 19:17:44 [DEBUG   ] Got command BAM from MCS: ref #7320
2021-03-31 19:17:44 [INFO    ] Finished processing BAM request
2021-03-31 19:17:44 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:17:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7320   8 59304 69464029 A  ERROR'
2021-03-31 19:17:44 [DEBUG   ] Got command BAM from MCS: ref #7321
2021-03-31 19:17:44 [INFO    ] Finished processing BAM request
2021-03-31 19:17:44 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:17:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7321   8 59304 69464033 A  ERROR'
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:17:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:17:44 [DEBUG   ] spawn_process: at 2021-03-31 19:17:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:17:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 19:18:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:18:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:18:02 [DEBUG   ] Finished updating board flags in 1.654 seconds
2021-03-31 19:18:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:18:33 [DEBUG   ] Got command BAM from MCS: ref #7322
2021-03-31 19:18:33 [INFO    ] Finished processing BAM request
2021-03-31 19:18:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7322   8 59304 69513033 A  ERROR'
2021-03-31 19:18:33 [DEBUG   ] Got command BAM from MCS: ref #7323
2021-03-31 19:18:33 [INFO    ] Finished processing BAM request
2021-03-31 19:18:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7323   8 59304 69513037 A  ERROR'
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:18:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:18:33 [DEBUG   ] spawn_process: at 2021-03-31 19:18:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:18:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:18:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:19:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:19:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:19:02 [DEBUG   ] Finished updating board flags in 1.122 seconds
2021-03-31 19:19:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 19:19:20 [DEBUG   ] Got command RPT from MCS: ref #7330
2021-03-31 19:19:20 [DEBUG   ] summary = ERROR
2021-03-31 19:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7330  13 59304 69560309 A  ERRORERROR'
2021-03-31 19:19:20 [DEBUG   ] Got command RPT from MCS: ref #7331
2021-03-31 19:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7331  77 59304 69560309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:19:22 [DEBUG   ] Got command BAM from MCS: ref #7347
2021-03-31 19:19:22 [INFO    ] Finished processing BAM request
2021-03-31 19:19:22 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:19:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7347   8 59304 69562029 A  ERROR'
2021-03-31 19:19:22 [DEBUG   ] Got command BAM from MCS: ref #7348
2021-03-31 19:19:22 [INFO    ] Finished processing BAM request
2021-03-31 19:19:22 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:19:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7348   8 59304 69562033 A  ERROR'
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:19:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:19:22 [DEBUG   ] spawn_process: at 2021-03-31 19:19:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:19:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:19:43 [DEBUG   ] Got command RPT from MCS: ref #7351
2021-03-31 19:19:43 [DEBUG   ] summary = ERROR
2021-03-31 19:19:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7351  13 59304 69583717 A  ERRORERROR'
2021-03-31 19:19:43 [DEBUG   ] Got command RPT from MCS: ref #7352
2021-03-31 19:19:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:19:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7352  77 59304 69583921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:19:44 [DEBUG   ] Got command RPT from MCS: ref #7353
2021-03-31 19:19:44 [DEBUG   ] summary = ERROR
2021-03-31 19:19:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7353  13 59304 69584113 A  ERRORERROR'
2021-03-31 19:19:44 [DEBUG   ] Got command RPT from MCS: ref #7354
2021-03-31 19:19:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:19:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7354  77 59304 69584317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:19:44 [DEBUG   ] Got command RPT from MCS: ref #7356
2021-03-31 19:19:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:19:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7356  12 59304 69584521 A  ERRORB¡ff'
2021-03-31 19:19:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:20:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:20:02 [DEBUG   ] Finished updating board flags in 1.069 seconds
2021-03-31 19:20:11 [DEBUG   ] Got command BAM from MCS: ref #7362
2021-03-31 19:20:11 [INFO    ] Finished processing BAM request
2021-03-31 19:20:11 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7362   8 59304 69611033 A  ERROR'
2021-03-31 19:20:11 [DEBUG   ] Got command BAM from MCS: ref #7361
2021-03-31 19:20:11 [INFO    ] Finished processing BAM request
2021-03-31 19:20:11 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7361   8 59304 69611041 A  ERROR'
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:20:11 [DEBUG   ] spawn_process: at 2021-03-31 19:20:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:20:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:20:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:20:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:21:00 [DEBUG   ] Got command BAM from MCS: ref #7364
2021-03-31 19:21:00 [INFO    ] Finished processing BAM request
2021-03-31 19:21:00 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7364   8 59304 69660029 A  ERROR'
2021-03-31 19:21:00 [DEBUG   ] Got command BAM from MCS: ref #7363
2021-03-31 19:21:00 [INFO    ] Finished processing BAM request
2021-03-31 19:21:00 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:21:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7363   8 59304 69660033 A  ERROR'
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 19:21:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 19:21:00 [DEBUG   ] spawn_process: at 2021-03-31 19:21:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 19:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-03-31 19:21:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-03-31 19:21:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:21:03 [DEBUG   ] Finished updating board flags in 1.995 seconds
2021-03-31 19:21:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 19:21:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:21:49 [DEBUG   ] Got command BAM from MCS: ref #7371
2021-03-31 19:21:49 [INFO    ] Finished processing BAM request
2021-03-31 19:21:49 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7371   8 59304 69709029 A  ERROR'
2021-03-31 19:21:49 [DEBUG   ] Got command BAM from MCS: ref #7372
2021-03-31 19:21:49 [INFO    ] Finished processing BAM request
2021-03-31 19:21:49 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:21:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7372   8 59304 69709033 A  ERROR'
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:21:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:21:49 [DEBUG   ] spawn_process: at 2021-03-31 19:21:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:21:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-03-31 19:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 19:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-03-31 19:22:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:22:02 [DEBUG   ] Finished updating board flags in 1.179 seconds
2021-03-31 19:22:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:22:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:22:38 [DEBUG   ] Got command BAM from MCS: ref #7373
2021-03-31 19:22:38 [INFO    ] Finished processing BAM request
2021-03-31 19:22:38 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7373   8 59304 69758025 A  ERROR'
2021-03-31 19:22:38 [DEBUG   ] Got command BAM from MCS: ref #7374
2021-03-31 19:22:38 [INFO    ] Finished processing BAM request
2021-03-31 19:22:38 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7374   8 59304 69758029 A  ERROR'
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 19:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 19:22:38 [DEBUG   ] spawn_process: at 2021-03-31 19:22:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 19:22:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:23:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:23:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:23:02 [DEBUG   ] Finished updating board flags in 1.015 seconds
2021-03-31 19:23:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:23:27 [DEBUG   ] Got command BAM from MCS: ref #7376
2021-03-31 19:23:27 [INFO    ] Finished processing BAM request
2021-03-31 19:23:27 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7376   8 59304 69807029 A  ERROR'
2021-03-31 19:23:27 [DEBUG   ] Got command BAM from MCS: ref #7375
2021-03-31 19:23:27 [INFO    ] Finished processing BAM request
2021-03-31 19:23:27 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7375   8 59304 69807033 A  ERROR'
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:23:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:23:27 [DEBUG   ] spawn_process: at 2021-03-31 19:23:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:23:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:23:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:24:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:24:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 19:24:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:24:02 [DEBUG   ] Finished updating board flags in 1.018 seconds
2021-03-31 19:24:16 [DEBUG   ] Got command BAM from MCS: ref #7378
2021-03-31 19:24:16 [INFO    ] Finished processing BAM request
2021-03-31 19:24:16 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7378   8 59304 69856025 A  ERROR'
2021-03-31 19:24:16 [DEBUG   ] Got command BAM from MCS: ref #7377
2021-03-31 19:24:16 [INFO    ] Finished processing BAM request
2021-03-31 19:24:16 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:24:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7377   8 59304 69856029 A  ERROR'
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:24:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:24:16 [DEBUG   ] spawn_process: at 2021-03-31 19:24:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:24:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:24:20 [DEBUG   ] Got command RPT from MCS: ref #7379
2021-03-31 19:24:20 [DEBUG   ] summary = ERROR
2021-03-31 19:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7379  13 59304 69860313 A  ERRORERROR'
2021-03-31 19:24:20 [DEBUG   ] Got command RPT from MCS: ref #7380
2021-03-31 19:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7380  77 59304 69860313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:24:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:24:43 [DEBUG   ] Got command RPT from MCS: ref #7399
2021-03-31 19:24:43 [DEBUG   ] summary = ERROR
2021-03-31 19:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7399  13 59304 69883797 A  ERRORERROR'
2021-03-31 19:24:43 [DEBUG   ] Got command RPT from MCS: ref #7401
2021-03-31 19:24:43 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7401  77 59304 69883989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:24:44 [DEBUG   ] Got command RPT from MCS: ref #7403
2021-03-31 19:24:44 [DEBUG   ] summary = ERROR
2021-03-31 19:24:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7403  13 59304 69884193 A  ERRORERROR'
2021-03-31 19:24:44 [DEBUG   ] Got command RPT from MCS: ref #7405
2021-03-31 19:24:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:24:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7405  77 59304 69884397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:24:44 [DEBUG   ] Got command RPT from MCS: ref #7406
2021-03-31 19:24:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:24:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7406  12 59304 69884589 A  ERRORB£ff'
2021-03-31 19:24:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:25:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:25:02 [DEBUG   ] Finished updating board flags in 1.018 seconds
2021-03-31 19:25:05 [DEBUG   ] Got command BAM from MCS: ref #7407
2021-03-31 19:25:05 [INFO    ] Finished processing BAM request
2021-03-31 19:25:05 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7407   8 59304 69905029 A  ERROR'
2021-03-31 19:25:05 [DEBUG   ] Got command BAM from MCS: ref #7408
2021-03-31 19:25:05 [INFO    ] Finished processing BAM request
2021-03-31 19:25:05 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7408   8 59304 69905033 A  ERROR'
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:25:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:25:05 [DEBUG   ] spawn_process: at 2021-03-31 19:25:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:25:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:25:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:25:54 [DEBUG   ] Got command BAM from MCS: ref #7410
2021-03-31 19:25:54 [INFO    ] Finished processing BAM request
2021-03-31 19:25:54 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7410   8 59304 69954033 A  ERROR'
2021-03-31 19:25:54 [DEBUG   ] Got command BAM from MCS: ref #7409
2021-03-31 19:25:54 [INFO    ] Finished processing BAM request
2021-03-31 19:25:54 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:25:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7409   8 59304 69954037 A  ERROR'
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:25:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:25:54 [DEBUG   ] spawn_process: at 2021-03-31 19:25:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:25:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:26:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 19:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-03-31 19:26:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:26:02 [DEBUG   ] Finished updating board flags in 0.969 seconds
2021-03-31 19:26:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:26:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:26:43 [DEBUG   ] Got command BAM from MCS: ref #7411
2021-03-31 19:26:43 [INFO    ] Finished processing BAM request
2021-03-31 19:26:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7411   8 59304 70003025 A  ERROR'
2021-03-31 19:26:43 [DEBUG   ] Got command BAM from MCS: ref #7412
2021-03-31 19:26:43 [INFO    ] Finished processing BAM request
2021-03-31 19:26:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7412   8 59304 70003029 A  ERROR'
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:26:43 [DEBUG   ] spawn_process: at 2021-03-31 19:26:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:26:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-03-31 19:27:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:27:03 [DEBUG   ] Finished updating board flags in 1.359 seconds
2021-03-31 19:27:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 19:27:32 [DEBUG   ] Got command BAM from MCS: ref #7414
2021-03-31 19:27:32 [INFO    ] Finished processing BAM request
2021-03-31 19:27:32 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7414   8 59304 70052029 A  ERROR'
2021-03-31 19:27:32 [DEBUG   ] Got command BAM from MCS: ref #7413
2021-03-31 19:27:32 [INFO    ] Finished processing BAM request
2021-03-31 19:27:32 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:27:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7413   8 59304 70052033 A  ERROR'
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:27:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:27:32 [DEBUG   ] spawn_process: at 2021-03-31 19:27:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:27:38 [DEBUG   ] Finished updating ant stats in 1.999 seconds
2021-03-31 19:27:57 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2021-03-31 19:28:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2021-03-31 19:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:28:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:28:03 [DEBUG   ] Finished updating board flags in 1.218 seconds
2021-03-31 19:28:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:28:21 [DEBUG   ] Got command BAM from MCS: ref #7422
2021-03-31 19:28:21 [INFO    ] Finished processing BAM request
2021-03-31 19:28:21 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7422   8 59304 70101033 A  ERROR'
2021-03-31 19:28:21 [DEBUG   ] Got command BAM from MCS: ref #7421
2021-03-31 19:28:21 [INFO    ] Finished processing BAM request
2021-03-31 19:28:21 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7421   8 59304 70101037 A  ERROR'
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:28:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:28:21 [DEBUG   ] spawn_process: at 2021-03-31 19:28:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:28:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:28:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 19:29:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:29:03 [DEBUG   ] Finished updating board flags in 1.203 seconds
2021-03-31 19:29:10 [DEBUG   ] Got command BAM from MCS: ref #7423
2021-03-31 19:29:10 [INFO    ] Finished processing BAM request
2021-03-31 19:29:10 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7423   8 59304 70150029 A  ERROR'
2021-03-31 19:29:10 [DEBUG   ] Got command BAM from MCS: ref #7424
2021-03-31 19:29:10 [INFO    ] Finished processing BAM request
2021-03-31 19:29:10 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:29:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7424   8 59304 70150033 A  ERROR'
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:29:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:29:10 [DEBUG   ] spawn_process: at 2021-03-31 19:29:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:29:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:29:20 [DEBUG   ] Got command RPT from MCS: ref #7425
2021-03-31 19:29:20 [DEBUG   ] summary = ERROR
2021-03-31 19:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7425  13 59304 70160313 A  ERRORERROR'
2021-03-31 19:29:20 [DEBUG   ] Got command RPT from MCS: ref #7426
2021-03-31 19:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7426  77 59304 70160313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:29:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:29:43 [DEBUG   ] Got command RPT from MCS: ref #7444
2021-03-31 19:29:43 [DEBUG   ] summary = ERROR
2021-03-31 19:29:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7444  13 59304 70183869 A  ERRORERROR'
2021-03-31 19:29:44 [DEBUG   ] Got command RPT from MCS: ref #7445
2021-03-31 19:29:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:29:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7445  77 59304 70184061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:29:44 [DEBUG   ] Got command RPT from MCS: ref #7446
2021-03-31 19:29:44 [DEBUG   ] summary = ERROR
2021-03-31 19:29:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7446  13 59304 70184265 A  ERRORERROR'
2021-03-31 19:29:44 [DEBUG   ] Got command RPT from MCS: ref #7447
2021-03-31 19:29:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:29:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7447  77 59304 70184469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:29:44 [DEBUG   ] Got command RPT from MCS: ref #7449
2021-03-31 19:29:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:29:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7449  12 59304 70184661 A  ERRORB£ff'
2021-03-31 19:29:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:29:59 [DEBUG   ] Got command BAM from MCS: ref #7454
2021-03-31 19:29:59 [INFO    ] Finished processing BAM request
2021-03-31 19:29:59 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7454   8 59304 70199029 A  ERROR'
2021-03-31 19:29:59 [DEBUG   ] Got command BAM from MCS: ref #7455
2021-03-31 19:29:59 [INFO    ] Finished processing BAM request
2021-03-31 19:29:59 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7455   8 59304 70199033 A  ERROR'
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:29:59 [DEBUG   ] spawn_process: at 2021-03-31 19:29:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:30:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:30:03 [DEBUG   ] Finished updating board flags in 1.186 seconds
2021-03-31 19:30:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:30:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:30:48 [DEBUG   ] Got command BAM from MCS: ref #7463
2021-03-31 19:30:48 [INFO    ] Finished processing BAM request
2021-03-31 19:30:48 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7463   8 59304 70248029 A  ERROR'
2021-03-31 19:30:48 [DEBUG   ] Got command BAM from MCS: ref #7462
2021-03-31 19:30:48 [INFO    ] Finished processing BAM request
2021-03-31 19:30:48 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7462   8 59304 70248033 A  ERROR'
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:30:48 [DEBUG   ] spawn_process: at 2021-03-31 19:30:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:30:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-03-31 19:31:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:31:03 [DEBUG   ] Finished updating board flags in 1.027 seconds
2021-03-31 19:31:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:31:37 [DEBUG   ] Got command BAM from MCS: ref #7464
2021-03-31 19:31:37 [INFO    ] Finished processing BAM request
2021-03-31 19:31:37 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7464   8 59304 70297025 A  ERROR'
2021-03-31 19:31:37 [DEBUG   ] Got command BAM from MCS: ref #7465
2021-03-31 19:31:37 [INFO    ] Finished processing BAM request
2021-03-31 19:31:37 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:31:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7465   8 59304 70297029 A  ERROR'
2021-03-31 19:31:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:31:37 [DEBUG   ] spawn_process: at 2021-03-31 19:31:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:31:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:32:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:32:04 [DEBUG   ] Finished updating board flags in 2.024 seconds
2021-03-31 19:32:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:32:26 [DEBUG   ] Got command BAM from MCS: ref #7466
2021-03-31 19:32:26 [INFO    ] Finished processing BAM request
2021-03-31 19:32:26 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7466   8 59304 70346033 A  ERROR'
2021-03-31 19:32:26 [DEBUG   ] Got command BAM from MCS: ref #7467
2021-03-31 19:32:26 [INFO    ] Finished processing BAM request
2021-03-31 19:32:26 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:32:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7467   8 59304 70346037 A  ERROR'
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:32:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:32:26 [DEBUG   ] spawn_process: at 2021-03-31 19:32:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:32:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:32:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 19:33:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 19:33:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:33:03 [DEBUG   ] Finished updating board flags in 1.408 seconds
2021-03-31 19:33:15 [DEBUG   ] Got command BAM from MCS: ref #7469
2021-03-31 19:33:15 [INFO    ] Finished processing BAM request
2021-03-31 19:33:15 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7469   8 59304 70395025 A  ERROR'
2021-03-31 19:33:15 [DEBUG   ] Got command BAM from MCS: ref #7468
2021-03-31 19:33:15 [INFO    ] Finished processing BAM request
2021-03-31 19:33:15 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:33:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7468   8 59304 70395029 A  ERROR'
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:33:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:33:15 [DEBUG   ] spawn_process: at 2021-03-31 19:33:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:33:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:33:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:33:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:34:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:34:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:34:03 [DEBUG   ] Finished updating board flags in 1.435 seconds
2021-03-31 19:34:04 [DEBUG   ] Got command BAM from MCS: ref #7477
2021-03-31 19:34:04 [INFO    ] Finished processing BAM request
2021-03-31 19:34:04 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:34:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7477   8 59304 70444029 A  ERROR'
2021-03-31 19:34:04 [DEBUG   ] Got command BAM from MCS: ref #7476
2021-03-31 19:34:04 [INFO    ] Finished processing BAM request
2021-03-31 19:34:04 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:34:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7476   8 59304 70444033 A  ERROR'
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:34:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:34:04 [DEBUG   ] spawn_process: at 2021-03-31 19:34:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:34:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:34:20 [DEBUG   ] Got command RPT from MCS: ref #7478
2021-03-31 19:34:20 [DEBUG   ] summary = ERROR
2021-03-31 19:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7478  13 59304 70460309 A  ERRORERROR'
2021-03-31 19:34:20 [DEBUG   ] Got command RPT from MCS: ref #7479
2021-03-31 19:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7479  77 59304 70460309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:34:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:34:43 [DEBUG   ] Got command RPT from MCS: ref #7495
2021-03-31 19:34:43 [DEBUG   ] summary = ERROR
2021-03-31 19:34:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7495  13 59304 70483937 A  ERRORERROR'
2021-03-31 19:34:44 [DEBUG   ] Got command RPT from MCS: ref #7496
2021-03-31 19:34:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:34:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7496  77 59304 70484141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:34:44 [DEBUG   ] Got command RPT from MCS: ref #7497
2021-03-31 19:34:44 [DEBUG   ] summary = ERROR
2021-03-31 19:34:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7497  13 59304 70484333 A  ERRORERROR'
2021-03-31 19:34:44 [DEBUG   ] Got command RPT from MCS: ref #7498
2021-03-31 19:34:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:34:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7498  77 59304 70484537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:34:44 [DEBUG   ] Got command RPT from MCS: ref #7499
2021-03-31 19:34:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:34:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7499  12 59304 70484741 A  ERRORB¢ff'
2021-03-31 19:34:53 [DEBUG   ] Got command BAM from MCS: ref #7500
2021-03-31 19:34:53 [INFO    ] Finished processing BAM request
2021-03-31 19:34:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7500   8 59304 70493025 A  ERROR'
2021-03-31 19:34:53 [DEBUG   ] Got command BAM from MCS: ref #7501
2021-03-31 19:34:53 [INFO    ] Finished processing BAM request
2021-03-31 19:34:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7501   8 59304 70493029 A  ERROR'
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:34:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:34:53 [DEBUG   ] spawn_process: at 2021-03-31 19:34:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:34:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 19:35:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:35:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:35:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:35:03 [DEBUG   ] Finished updating board flags in 1.346 seconds
2021-03-31 19:35:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:35:38 [DEBUG   ] Finished updating ant stats in 1.802 seconds
2021-03-31 19:35:42 [DEBUG   ] Got command BAM from MCS: ref #7502
2021-03-31 19:35:42 [INFO    ] Finished processing BAM request
2021-03-31 19:35:42 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:35:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7502   8 59304 70542029 A  ERROR'
2021-03-31 19:35:42 [DEBUG   ] Got command BAM from MCS: ref #7503
2021-03-31 19:35:42 [INFO    ] Finished processing BAM request
2021-03-31 19:35:42 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:35:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7503   8 59304 70542033 A  ERROR'
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:35:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:35:42 [DEBUG   ] spawn_process: at 2021-03-31 19:35:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:35:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:36:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:36:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:36:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:36:03 [DEBUG   ] Finished updating board flags in 1.235 seconds
2021-03-31 19:36:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:36:31 [DEBUG   ] Got command BAM from MCS: ref #7504
2021-03-31 19:36:31 [INFO    ] Finished processing BAM request
2021-03-31 19:36:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:36:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7504   8 59304 70591029 A  ERROR'
2021-03-31 19:36:31 [DEBUG   ] Got command BAM from MCS: ref #7505
2021-03-31 19:36:31 [INFO    ] Finished processing BAM request
2021-03-31 19:36:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:36:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7505   8 59304 70591033 A  ERROR'
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 19:36:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 19:36:31 [DEBUG   ] spawn_process: at 2021-03-31 19:36:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 19:36:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:36:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:37:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:37:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:37:03 [DEBUG   ] Finished updating board flags in 1.218 seconds
2021-03-31 19:37:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 19:37:20 [DEBUG   ] Got command BAM from MCS: ref #7513
2021-03-31 19:37:20 [INFO    ] Finished processing BAM request
2021-03-31 19:37:20 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7513   8 59304 70640029 A  ERROR'
2021-03-31 19:37:20 [DEBUG   ] Got command BAM from MCS: ref #7512
2021-03-31 19:37:20 [INFO    ] Finished processing BAM request
2021-03-31 19:37:20 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7512   8 59304 70640033 A  ERROR'
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 19:37:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 19:37:20 [DEBUG   ] spawn_process: at 2021-03-31 19:37:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 19:37:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:37:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 19:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:38:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:38:03 [DEBUG   ] Finished updating board flags in 1.179 seconds
2021-03-31 19:38:09 [DEBUG   ] Got command BAM from MCS: ref #7514
2021-03-31 19:38:09 [INFO    ] Finished processing BAM request
2021-03-31 19:38:09 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7514   8 59304 70689029 A  ERROR'
2021-03-31 19:38:09 [DEBUG   ] Got command BAM from MCS: ref #7515
2021-03-31 19:38:09 [INFO    ] Finished processing BAM request
2021-03-31 19:38:09 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:38:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7515   8 59304 70689037 A  ERROR'
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:38:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:38:09 [DEBUG   ] spawn_process: at 2021-03-31 19:38:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:38:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:38:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 19:38:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:38:58 [DEBUG   ] Got command BAM from MCS: ref #7516
2021-03-31 19:38:58 [INFO    ] Finished processing BAM request
2021-03-31 19:38:58 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7516   8 59304 70738029 A  ERROR'
2021-03-31 19:38:58 [DEBUG   ] Got command BAM from MCS: ref #7517
2021-03-31 19:38:58 [INFO    ] Finished processing BAM request
2021-03-31 19:38:58 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:38:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7517   8 59304 70738033 A  ERROR'
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:38:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:38:58 [DEBUG   ] spawn_process: at 2021-03-31 19:38:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:39:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 19:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:39:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:39:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:39:03 [DEBUG   ] Finished updating board flags in 1.023 seconds
2021-03-31 19:39:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:39:20 [DEBUG   ] Got command RPT from MCS: ref #7518
2021-03-31 19:39:20 [DEBUG   ] summary = ERROR
2021-03-31 19:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7518  13 59304 70760317 A  ERRORERROR'
2021-03-31 19:39:20 [DEBUG   ] Got command RPT from MCS: ref #7519
2021-03-31 19:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7519  77 59304 70760317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:39:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:39:44 [DEBUG   ] Got command RPT from MCS: ref #7540
2021-03-31 19:39:44 [DEBUG   ] summary = ERROR
2021-03-31 19:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7540  13 59304 70784017 A  ERRORERROR'
2021-03-31 19:39:44 [DEBUG   ] Got command RPT from MCS: ref #7542
2021-03-31 19:39:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7542  77 59304 70784209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:39:44 [DEBUG   ] Got command RPT from MCS: ref #7544
2021-03-31 19:39:44 [DEBUG   ] summary = ERROR
2021-03-31 19:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7544  13 59304 70784413 A  ERRORERROR'
2021-03-31 19:39:44 [DEBUG   ] Got command RPT from MCS: ref #7546
2021-03-31 19:39:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7546  77 59304 70784617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:39:44 [DEBUG   ] Got command RPT from MCS: ref #7548
2021-03-31 19:39:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7548  12 59304 70784809 A  ERRORB¢ff'
2021-03-31 19:39:47 [DEBUG   ] Got command BAM from MCS: ref #7554
2021-03-31 19:39:47 [INFO    ] Finished processing BAM request
2021-03-31 19:39:47 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7554   8 59304 70787033 A  ERROR'
2021-03-31 19:39:47 [DEBUG   ] Got command BAM from MCS: ref #7553
2021-03-31 19:39:47 [INFO    ] Finished processing BAM request
2021-03-31 19:39:47 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7553   8 59304 70787037 A  ERROR'
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:39:47 [DEBUG   ] spawn_process: at 2021-03-31 19:39:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:39:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:40:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:40:04 [DEBUG   ] Finished updating board flags in 1.570 seconds
2021-03-31 19:40:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:40:36 [DEBUG   ] Got command BAM from MCS: ref #7555
2021-03-31 19:40:36 [INFO    ] Finished processing BAM request
2021-03-31 19:40:36 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:40:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7555   8 59304 70836029 A  ERROR'
2021-03-31 19:40:36 [DEBUG   ] Got command BAM from MCS: ref #7556
2021-03-31 19:40:36 [INFO    ] Finished processing BAM request
2021-03-31 19:40:36 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:40:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7556   8 59304 70836033 A  ERROR'
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:40:36 [DEBUG   ] spawn_process: at 2021-03-31 19:40:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:40:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:40:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 19:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 19:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:41:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:41:04 [DEBUG   ] Finished updating board flags in 1.363 seconds
2021-03-31 19:41:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:41:25 [DEBUG   ] Got command BAM from MCS: ref #7558
2021-03-31 19:41:25 [INFO    ] Finished processing BAM request
2021-03-31 19:41:25 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7558   8 59304 70885025 A  ERROR'
2021-03-31 19:41:25 [DEBUG   ] Got command BAM from MCS: ref #7557
2021-03-31 19:41:25 [INFO    ] Finished processing BAM request
2021-03-31 19:41:25 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:41:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7557   8 59304 70885029 A  ERROR'
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:41:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:41:25 [DEBUG   ] spawn_process: at 2021-03-31 19:41:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:41:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:41:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:42:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:42:04 [DEBUG   ] Finished updating board flags in 1.212 seconds
2021-03-31 19:42:14 [DEBUG   ] Got command BAM from MCS: ref #7560
2021-03-31 19:42:14 [INFO    ] Finished processing BAM request
2021-03-31 19:42:14 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:42:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7560   8 59304 70934033 A  ERROR'
2021-03-31 19:42:14 [DEBUG   ] Got command BAM from MCS: ref #7559
2021-03-31 19:42:14 [INFO    ] Finished processing BAM request
2021-03-31 19:42:14 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:42:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7559   8 59304 70934037 A  ERROR'
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:42:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:42:14 [DEBUG   ] spawn_process: at 2021-03-31 19:42:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:42:17 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2021-03-31 19:42:38 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2021-03-31 19:42:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:43:03 [DEBUG   ] Got command BAM from MCS: ref #7567
2021-03-31 19:43:03 [INFO    ] Finished processing BAM request
2021-03-31 19:43:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:43:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7567   8 59304 70983029 A  ERROR'
2021-03-31 19:43:03 [DEBUG   ] Got command BAM from MCS: ref #7568
2021-03-31 19:43:03 [INFO    ] Finished processing BAM request
2021-03-31 19:43:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:43:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7568   8 59304 70983033 A  ERROR'
2021-03-31 19:43:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:43:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:43:03 [DEBUG   ] spawn_process: at 2021-03-31 19:43:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:43:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:43:04 [DEBUG   ] Finished updating board flags in 1.178 seconds
2021-03-31 19:43:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:43:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:43:52 [DEBUG   ] Got command BAM from MCS: ref #7569
2021-03-31 19:43:52 [INFO    ] Finished processing BAM request
2021-03-31 19:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7569   8 59304 71032025 A  ERROR'
2021-03-31 19:43:52 [DEBUG   ] Got command BAM from MCS: ref #7570
2021-03-31 19:43:52 [INFO    ] Finished processing BAM request
2021-03-31 19:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7570   8 59304 71032029 A  ERROR'
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:43:52 [DEBUG   ] spawn_process: at 2021-03-31 19:43:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:43:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:44:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:44:04 [DEBUG   ] Finished updating board flags in 1.016 seconds
2021-03-31 19:44:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:44:20 [DEBUG   ] Got command RPT from MCS: ref #7571
2021-03-31 19:44:20 [DEBUG   ] summary = ERROR
2021-03-31 19:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7571  13 59304 71060313 A  ERRORERROR'
2021-03-31 19:44:20 [DEBUG   ] Got command RPT from MCS: ref #7572
2021-03-31 19:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7572  77 59304 71060313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:44:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:44:41 [DEBUG   ] Got command BAM from MCS: ref #7589
2021-03-31 19:44:41 [INFO    ] Finished processing BAM request
2021-03-31 19:44:41 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7589   8 59304 71081029 A  ERROR'
2021-03-31 19:44:41 [DEBUG   ] Got command BAM from MCS: ref #7588
2021-03-31 19:44:41 [INFO    ] Finished processing BAM request
2021-03-31 19:44:41 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:44:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7588   8 59304 71081033 A  ERROR'
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:44:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:44:41 [DEBUG   ] spawn_process: at 2021-03-31 19:44:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:44:44 [DEBUG   ] Got command RPT from MCS: ref #7590
2021-03-31 19:44:44 [DEBUG   ] summary = ERROR
2021-03-31 19:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7590  13 59304 71084081 A  ERRORERROR'
2021-03-31 19:44:44 [DEBUG   ] Got command RPT from MCS: ref #7591
2021-03-31 19:44:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7591  77 59304 71084285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:44:44 [DEBUG   ] Got command RPT from MCS: ref #7592
2021-03-31 19:44:44 [DEBUG   ] summary = ERROR
2021-03-31 19:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7592  13 59304 71084489 A  ERRORERROR'
2021-03-31 19:44:44 [DEBUG   ] Got command RPT from MCS: ref #7593
2021-03-31 19:44:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7593  77 59304 71084681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:44:44 [DEBUG   ] Got command RPT from MCS: ref #7594
2021-03-31 19:44:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7594  12 59304 71084885 A  ERRORB¡ff'
2021-03-31 19:44:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:45:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:45:04 [DEBUG   ] Finished updating board flags in 1.003 seconds
2021-03-31 19:45:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:45:30 [DEBUG   ] Got command BAM from MCS: ref #7595
2021-03-31 19:45:30 [INFO    ] Finished processing BAM request
2021-03-31 19:45:30 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7595   8 59304 71130033 A  ERROR'
2021-03-31 19:45:30 [DEBUG   ] Got command BAM from MCS: ref #7596
2021-03-31 19:45:30 [INFO    ] Finished processing BAM request
2021-03-31 19:45:30 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:45:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7596   8 59304 71130037 A  ERROR'
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:45:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:45:30 [DEBUG   ] spawn_process: at 2021-03-31 19:45:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:45:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:45:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 19:46:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:46:04 [DEBUG   ] Finished updating board flags in 1.015 seconds
2021-03-31 19:46:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:46:19 [DEBUG   ] Got command BAM from MCS: ref #7603
2021-03-31 19:46:19 [INFO    ] Finished processing BAM request
2021-03-31 19:46:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7603   8 59304 71179025 A  ERROR'
2021-03-31 19:46:19 [DEBUG   ] Got command BAM from MCS: ref #7604
2021-03-31 19:46:19 [INFO    ] Finished processing BAM request
2021-03-31 19:46:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7604   8 59304 71179029 A  ERROR'
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 19:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 19:46:19 [DEBUG   ] spawn_process: at 2021-03-31 19:46:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 19:46:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 19:46:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:47:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:47:04 [DEBUG   ] Finished updating board flags in 1.056 seconds
2021-03-31 19:47:08 [DEBUG   ] Got command BAM from MCS: ref #7606
2021-03-31 19:47:08 [INFO    ] Finished processing BAM request
2021-03-31 19:47:08 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7606   8 59304 71228033 A  ERROR'
2021-03-31 19:47:08 [DEBUG   ] Got command BAM from MCS: ref #7605
2021-03-31 19:47:08 [INFO    ] Finished processing BAM request
2021-03-31 19:47:08 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:47:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7605   8 59304 71228037 A  ERROR'
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 19:47:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 19:47:08 [DEBUG   ] spawn_process: at 2021-03-31 19:47:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 19:47:17 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-03-31 19:47:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 19:47:57 [DEBUG   ] Got command BAM from MCS: ref #7608
2021-03-31 19:47:57 [INFO    ] Finished processing BAM request
2021-03-31 19:47:57 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:47:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7608   8 59304 71277029 A  ERROR'
2021-03-31 19:47:57 [DEBUG   ] Got command BAM from MCS: ref #7607
2021-03-31 19:47:57 [INFO    ] Finished processing BAM request
2021-03-31 19:47:57 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:47:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7607   8 59304 71277033 A  ERROR'
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:47:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:47:57 [DEBUG   ] spawn_process: at 2021-03-31 19:47:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:47:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:48:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:48:04 [DEBUG   ] Finished updating board flags in 1.464 seconds
2021-03-31 19:48:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:48:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:48:46 [DEBUG   ] Got command BAM from MCS: ref #7616
2021-03-31 19:48:46 [INFO    ] Finished processing BAM request
2021-03-31 19:48:46 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:48:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7616   8 59304 71326025 A  ERROR'
2021-03-31 19:48:46 [DEBUG   ] Got command BAM from MCS: ref #7615
2021-03-31 19:48:46 [INFO    ] Finished processing BAM request
2021-03-31 19:48:46 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:48:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7615   8 59304 71326029 A  ERROR'
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:48:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:48:46 [DEBUG   ] spawn_process: at 2021-03-31 19:48:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:48:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 19:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-03-31 19:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:49:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:49:04 [DEBUG   ] Finished updating board flags in 1.405 seconds
2021-03-31 19:49:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:49:20 [DEBUG   ] Got command RPT from MCS: ref #7617
2021-03-31 19:49:20 [DEBUG   ] summary = ERROR
2021-03-31 19:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7617  13 59304 71360313 A  ERRORERROR'
2021-03-31 19:49:20 [DEBUG   ] Got command RPT from MCS: ref #7618
2021-03-31 19:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7618  77 59304 71360313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:49:35 [DEBUG   ] Got command BAM from MCS: ref #7634
2021-03-31 19:49:35 [INFO    ] Finished processing BAM request
2021-03-31 19:49:35 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:49:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7634   8 59304 71375029 A  ERROR'
2021-03-31 19:49:35 [DEBUG   ] Got command BAM from MCS: ref #7635
2021-03-31 19:49:35 [INFO    ] Finished processing BAM request
2021-03-31 19:49:35 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:49:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7635   8 59304 71375033 A  ERROR'
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-03-31 19:49:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-03-31 19:49:35 [DEBUG   ] spawn_process: at 2021-03-31 19:49:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-03-31 19:49:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:49:44 [DEBUG   ] Got command RPT from MCS: ref #7638
2021-03-31 19:49:44 [DEBUG   ] summary = ERROR
2021-03-31 19:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7638  13 59304 71384161 A  ERRORERROR'
2021-03-31 19:49:44 [DEBUG   ] Got command RPT from MCS: ref #7639
2021-03-31 19:49:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7639  77 59304 71384353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:49:44 [DEBUG   ] Got command RPT from MCS: ref #7640
2021-03-31 19:49:44 [DEBUG   ] summary = ERROR
2021-03-31 19:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7640  13 59304 71384557 A  ERRORERROR'
2021-03-31 19:49:44 [DEBUG   ] Got command RPT from MCS: ref #7641
2021-03-31 19:49:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7641  77 59304 71384761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:49:44 [DEBUG   ] Got command RPT from MCS: ref #7643
2021-03-31 19:49:44 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7643  12 59304 71384953 A  ERRORB¡ff'
2021-03-31 19:49:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:50:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:50:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:50:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:50:04 [DEBUG   ] Finished updating board flags in 1.301 seconds
2021-03-31 19:50:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:50:24 [DEBUG   ] Got command BAM from MCS: ref #7649
2021-03-31 19:50:24 [INFO    ] Finished processing BAM request
2021-03-31 19:50:24 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7649   8 59304 71424025 A  ERROR'
2021-03-31 19:50:24 [DEBUG   ] Got command BAM from MCS: ref #7648
2021-03-31 19:50:24 [INFO    ] Finished processing BAM request
2021-03-31 19:50:24 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:50:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7648   8 59304 71424029 A  ERROR'
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:50:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:50:24 [DEBUG   ] spawn_process: at 2021-03-31 19:50:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:50:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:50:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 19:51:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:51:05 [DEBUG   ] Finished updating board flags in 1.775 seconds
2021-03-31 19:51:13 [DEBUG   ] Got command BAM from MCS: ref #7651
2021-03-31 19:51:13 [INFO    ] Finished processing BAM request
2021-03-31 19:51:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:51:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7651   8 59304 71473033 A  ERROR'
2021-03-31 19:51:13 [DEBUG   ] Got command BAM from MCS: ref #7650
2021-03-31 19:51:13 [INFO    ] Finished processing BAM request
2021-03-31 19:51:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:51:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7650   8 59304 71473037 A  ERROR'
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:51:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:51:13 [DEBUG   ] spawn_process: at 2021-03-31 19:51:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:51:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:51:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:51:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:52:02 [DEBUG   ] Got command BAM from MCS: ref #7659
2021-03-31 19:52:02 [INFO    ] Finished processing BAM request
2021-03-31 19:52:02 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7659   8 59304 71522025 A  ERROR'
2021-03-31 19:52:02 [DEBUG   ] Got command BAM from MCS: ref #7658
2021-03-31 19:52:02 [INFO    ] Finished processing BAM request
2021-03-31 19:52:02 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:52:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7658   8 59304 71522029 A  ERROR'
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:52:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:52:02 [DEBUG   ] spawn_process: at 2021-03-31 19:52:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:52:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:52:04 [DEBUG   ] Finished updating board flags in 1.032 seconds
2021-03-31 19:52:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:52:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 19:52:51 [DEBUG   ] Got command BAM from MCS: ref #7660
2021-03-31 19:52:51 [INFO    ] Finished processing BAM request
2021-03-31 19:52:51 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:52:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7660   8 59304 71571033 A  ERROR'
2021-03-31 19:52:51 [DEBUG   ] Got command BAM from MCS: ref #7661
2021-03-31 19:52:51 [INFO    ] Finished processing BAM request
2021-03-31 19:52:51 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:52:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7661   8 59304 71571037 A  ERROR'
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:52:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:52:51 [DEBUG   ] spawn_process: at 2021-03-31 19:52:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:52:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 19:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-03-31 19:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-03-31 19:53:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:53:05 [DEBUG   ] Finished updating board flags in 1.574 seconds
2021-03-31 19:53:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:53:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 19:53:40 [DEBUG   ] Got command BAM from MCS: ref #7662
2021-03-31 19:53:40 [INFO    ] Finished processing BAM request
2021-03-31 19:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7662   8 59304 71620025 A  ERROR'
2021-03-31 19:53:40 [DEBUG   ] Got command BAM from MCS: ref #7663
2021-03-31 19:53:40 [INFO    ] Finished processing BAM request
2021-03-31 19:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7663   8 59304 71620029 A  ERROR'
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:53:40 [DEBUG   ] spawn_process: at 2021-03-31 19:53:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:53:58 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2021-03-31 19:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:54:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:54:05 [DEBUG   ] Finished updating board flags in 1.380 seconds
2021-03-31 19:54:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:54:20 [DEBUG   ] Got command RPT from MCS: ref #7664
2021-03-31 19:54:20 [DEBUG   ] summary = ERROR
2021-03-31 19:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7664  13 59304 71660313 A  ERRORERROR'
2021-03-31 19:54:20 [DEBUG   ] Got command RPT from MCS: ref #7665
2021-03-31 19:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7665  77 59304 71660313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:54:29 [DEBUG   ] Got command BAM from MCS: ref #7681
2021-03-31 19:54:29 [INFO    ] Finished processing BAM request
2021-03-31 19:54:29 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7681   8 59304 71669033 A  ERROR'
2021-03-31 19:54:29 [DEBUG   ] Got command BAM from MCS: ref #7682
2021-03-31 19:54:29 [INFO    ] Finished processing BAM request
2021-03-31 19:54:29 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7682   8 59304 71669037 A  ERROR'
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:54:29 [DEBUG   ] spawn_process: at 2021-03-31 19:54:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:54:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:54:44 [DEBUG   ] Got command RPT from MCS: ref #7686
2021-03-31 19:54:44 [DEBUG   ] summary = ERROR
2021-03-31 19:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7686  13 59304 71684229 A  ERRORERROR'
2021-03-31 19:54:44 [DEBUG   ] Got command RPT from MCS: ref #7688
2021-03-31 19:54:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7688  77 59304 71684433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:54:44 [DEBUG   ] Got command RPT from MCS: ref #7690
2021-03-31 19:54:44 [DEBUG   ] summary = ERROR
2021-03-31 19:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7690  13 59304 71684625 A  ERRORERROR'
2021-03-31 19:54:44 [DEBUG   ] Got command RPT from MCS: ref #7692
2021-03-31 19:54:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7692  77 59304 71684829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:54:45 [DEBUG   ] Got command RPT from MCS: ref #7693
2021-03-31 19:54:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7693  12 59304 71685033 A  ERRORB¡ff'
2021-03-31 19:54:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:55:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 19:55:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:55:05 [DEBUG   ] Finished updating board flags in 1.205 seconds
2021-03-31 19:55:18 [DEBUG   ] Got command BAM from MCS: ref #7695
2021-03-31 19:55:18 [INFO    ] Finished processing BAM request
2021-03-31 19:55:18 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7695   8 59304 71718025 A  ERROR'
2021-03-31 19:55:18 [DEBUG   ] Got command BAM from MCS: ref #7694
2021-03-31 19:55:18 [INFO    ] Finished processing BAM request
2021-03-31 19:55:18 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:55:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7694   8 59304 71718029 A  ERROR'
2021-03-31 19:55:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 19:55:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 19:55:18 [DEBUG   ] spawn_process: at 2021-03-31 19:55:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 19:55:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:55:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:56:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:56:05 [DEBUG   ] Finished updating board flags in 1.270 seconds
2021-03-31 19:56:07 [DEBUG   ] Got command BAM from MCS: ref #7696
2021-03-31 19:56:07 [INFO    ] Finished processing BAM request
2021-03-31 19:56:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7696   8 59304 71767029 A  ERROR'
2021-03-31 19:56:07 [DEBUG   ] Got command BAM from MCS: ref #7697
2021-03-31 19:56:07 [INFO    ] Finished processing BAM request
2021-03-31 19:56:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:56:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7697   8 59304 71767033 A  ERROR'
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 19:56:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 19:56:07 [DEBUG   ] spawn_process: at 2021-03-31 19:56:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 19:56:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:56:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:56:56 [DEBUG   ] Got command BAM from MCS: ref #7698
2021-03-31 19:56:56 [INFO    ] Finished processing BAM request
2021-03-31 19:56:56 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7698   8 59304 71816033 A  ERROR'
2021-03-31 19:56:56 [DEBUG   ] Got command BAM from MCS: ref #7699
2021-03-31 19:56:56 [INFO    ] Finished processing BAM request
2021-03-31 19:56:56 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7699   8 59304 71816037 A  ERROR'
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:56:56 [DEBUG   ] spawn_process: at 2021-03-31 19:56:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:56:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:57:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:57:05 [DEBUG   ] Finished updating board flags in 1.134 seconds
2021-03-31 19:57:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:57:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:57:45 [DEBUG   ] Got command BAM from MCS: ref #7703
2021-03-31 19:57:45 [INFO    ] Finished processing BAM request
2021-03-31 19:57:45 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:57:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7703   8 59304 71865025 A  ERROR'
2021-03-31 19:57:45 [DEBUG   ] Got command BAM from MCS: ref #7702
2021-03-31 19:57:45 [INFO    ] Finished processing BAM request
2021-03-31 19:57:45 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:57:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7702   8 59304 71865029 A  ERROR'
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:57:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:57:45 [DEBUG   ] spawn_process: at 2021-03-31 19:57:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:57:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 19:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:58:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:58:05 [DEBUG   ] Finished updating board flags in 1.008 seconds
2021-03-31 19:58:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 19:58:34 [DEBUG   ] Got command BAM from MCS: ref #7709
2021-03-31 19:58:34 [INFO    ] Finished processing BAM request
2021-03-31 19:58:34 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7709   8 59304 71914025 A  ERROR'
2021-03-31 19:58:34 [DEBUG   ] Got command BAM from MCS: ref #7708
2021-03-31 19:58:34 [INFO    ] Finished processing BAM request
2021-03-31 19:58:34 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7708   8 59304 71914029 A  ERROR'
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-03-31 19:58:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-03-31 19:58:34 [DEBUG   ] spawn_process: at 2021-03-31 19:58:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-03-31 19:58:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 19:58:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 19:59:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 19:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 19:59:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 19:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-03-31 19:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 19:59:05 [DEBUG   ] Finished updating board flags in 0.997 seconds
2021-03-31 19:59:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 19:59:20 [DEBUG   ] Got command RPT from MCS: ref #7710
2021-03-31 19:59:20 [DEBUG   ] summary = ERROR
2021-03-31 19:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7710  13 59304 71960317 A  ERRORERROR'
2021-03-31 19:59:20 [DEBUG   ] Got command RPT from MCS: ref #7711
2021-03-31 19:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7711  77 59304 71960317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:59:23 [DEBUG   ] Got command BAM from MCS: ref #7727
2021-03-31 19:59:23 [INFO    ] Finished processing BAM request
2021-03-31 19:59:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7727   8 59304 71963033 A  ERROR'
2021-03-31 19:59:23 [DEBUG   ] Got command BAM from MCS: ref #7728
2021-03-31 19:59:23 [INFO    ] Finished processing BAM request
2021-03-31 19:59:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 19:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7728   8 59304 71963037 A  ERROR'
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 19:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 19:59:23 [DEBUG   ] spawn_process: at 2021-03-31 19:59:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 19:59:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 19:59:44 [DEBUG   ] Got command RPT from MCS: ref #7731
2021-03-31 19:59:44 [DEBUG   ] summary = ERROR
2021-03-31 19:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7731  13 59304 71984301 A  ERRORERROR'
2021-03-31 19:59:44 [DEBUG   ] Got command RPT from MCS: ref #7732
2021-03-31 19:59:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7732  77 59304 71984493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:59:44 [DEBUG   ] Got command RPT from MCS: ref #7733
2021-03-31 19:59:44 [DEBUG   ] summary = ERROR
2021-03-31 19:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7733  13 59304 71984697 A  ERRORERROR'
2021-03-31 19:59:44 [DEBUG   ] Got command RPT from MCS: ref #7734
2021-03-31 19:59:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 19:59:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7734  77 59304 71984901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 19:59:45 [DEBUG   ] Got command RPT from MCS: ref #7736
2021-03-31 19:59:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 19:59:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7736  12 59304 71985105 A  ERRORB¡ff'
2021-03-31 19:59:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:00:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:00:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 20:00:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:00:06 [DEBUG   ] Finished updating board flags in 1.806 seconds
2021-03-31 20:00:12 [DEBUG   ] Got command BAM from MCS: ref #7742
2021-03-31 20:00:12 [INFO    ] Finished processing BAM request
2021-03-31 20:00:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7742   8 59304 72012025 A  ERROR'
2021-03-31 20:00:12 [DEBUG   ] Got command BAM from MCS: ref #7741
2021-03-31 20:00:12 [INFO    ] Finished processing BAM request
2021-03-31 20:00:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:00:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7741   8 59304 72012029 A  ERROR'
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 20:00:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 20:00:12 [DEBUG   ] spawn_process: at 2021-03-31 20:00:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 20:00:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:00:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:00:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:01:01 [DEBUG   ] Got command BAM from MCS: ref #7749
2021-03-31 20:01:01 [INFO    ] Finished processing BAM request
2021-03-31 20:01:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7749   8 59304 72061025 A  ERROR'
2021-03-31 20:01:01 [DEBUG   ] Got command BAM from MCS: ref #7750
2021-03-31 20:01:01 [INFO    ] Finished processing BAM request
2021-03-31 20:01:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:01:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7750   8 59304 72061029 A  ERROR'
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 20:01:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 20:01:01 [DEBUG   ] spawn_process: at 2021-03-31 20:01:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 20:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:01:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 20:01:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:01:05 [DEBUG   ] Finished updating board flags in 1.239 seconds
2021-03-31 20:01:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:01:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:01:50 [DEBUG   ] Got command BAM from MCS: ref #7751
2021-03-31 20:01:50 [INFO    ] Finished processing BAM request
2021-03-31 20:01:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7751   8 59304 72110033 A  ERROR'
2021-03-31 20:01:50 [DEBUG   ] Got command BAM from MCS: ref #7752
2021-03-31 20:01:50 [INFO    ] Finished processing BAM request
2021-03-31 20:01:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:01:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7752   8 59304 72110037 A  ERROR'
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 20:01:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 20:01:50 [DEBUG   ] spawn_process: at 2021-03-31 20:01:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 20:01:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:02:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 20:02:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:02:06 [DEBUG   ] Finished updating board flags in 1.784 seconds
2021-03-31 20:02:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:02:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:02:39 [DEBUG   ] Got command BAM from MCS: ref #7753
2021-03-31 20:02:39 [INFO    ] Finished processing BAM request
2021-03-31 20:02:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7753   8 59304 72159025 A  ERROR'
2021-03-31 20:02:39 [DEBUG   ] Got command BAM from MCS: ref #7754
2021-03-31 20:02:39 [INFO    ] Finished processing BAM request
2021-03-31 20:02:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:02:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7754   8 59304 72159029 A  ERROR'
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 20:02:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 20:02:39 [DEBUG   ] spawn_process: at 2021-03-31 20:02:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 20:02:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:03:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 20:03:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:03:06 [DEBUG   ] Finished updating board flags in 1.584 seconds
2021-03-31 20:03:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:03:28 [DEBUG   ] Got command BAM from MCS: ref #7755
2021-03-31 20:03:28 [INFO    ] Finished processing BAM request
2021-03-31 20:03:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7755   8 59304 72208029 A  ERROR'
2021-03-31 20:03:28 [DEBUG   ] Got command BAM from MCS: ref #7756
2021-03-31 20:03:28 [INFO    ] Finished processing BAM request
2021-03-31 20:03:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7756   8 59304 72208033 A  ERROR'
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 20:03:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 20:03:28 [DEBUG   ] spawn_process: at 2021-03-31 20:03:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 20:03:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:03:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 20:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:04:06 [DEBUG   ] Finished updating board flags in 1.408 seconds
2021-03-31 20:04:17 [DEBUG   ] Got command BAM from MCS: ref #7763
2021-03-31 20:04:17 [INFO    ] Finished processing BAM request
2021-03-31 20:04:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7763   8 59304 72257033 A  ERROR'
2021-03-31 20:04:17 [DEBUG   ] Got command BAM from MCS: ref #7764
2021-03-31 20:04:17 [INFO    ] Finished processing BAM request
2021-03-31 20:04:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:04:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7764   8 59304 72257037 A  ERROR'
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 20:04:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 20:04:17 [DEBUG   ] spawn_process: at 2021-03-31 20:04:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 20:04:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:04:20 [DEBUG   ] Got command RPT from MCS: ref #7765
2021-03-31 20:04:20 [DEBUG   ] summary = ERROR
2021-03-31 20:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7765  13 59304 72260325 A  ERRORERROR'
2021-03-31 20:04:20 [DEBUG   ] Got command RPT from MCS: ref #7766
2021-03-31 20:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7766  77 59304 72260325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:04:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:04:44 [DEBUG   ] Got command RPT from MCS: ref #7782
2021-03-31 20:04:44 [DEBUG   ] summary = ERROR
2021-03-31 20:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7782  13 59304 72284373 A  ERRORERROR'
2021-03-31 20:04:44 [DEBUG   ] Got command RPT from MCS: ref #7783
2021-03-31 20:04:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7783  77 59304 72284565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:04:44 [DEBUG   ] Got command RPT from MCS: ref #7784
2021-03-31 20:04:44 [DEBUG   ] summary = ERROR
2021-03-31 20:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7784  13 59304 72284769 A  ERRORERROR'
2021-03-31 20:04:44 [DEBUG   ] Got command RPT from MCS: ref #7785
2021-03-31 20:04:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:04:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7785  77 59304 72284973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:04:45 [DEBUG   ] Got command RPT from MCS: ref #7786
2021-03-31 20:04:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7786  12 59304 72285165 A  ERRORBŸff'
2021-03-31 20:04:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:05:06 [DEBUG   ] Got command BAM from MCS: ref #7787
2021-03-31 20:05:06 [INFO    ] Finished processing BAM request
2021-03-31 20:05:06 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7787   8 59304 72306025 A  ERROR'
2021-03-31 20:05:06 [DEBUG   ] Got command BAM from MCS: ref #7788
2021-03-31 20:05:06 [INFO    ] Finished processing BAM request
2021-03-31 20:05:06 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:05:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7788   8 59304 72306029 A  ERROR'
2021-03-31 20:05:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 20:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:05:06 [DEBUG   ] Finished updating board flags in 1.455 seconds
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 20:05:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 20:05:06 [DEBUG   ] spawn_process: at 2021-03-31 20:05:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 20:05:18 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-03-31 20:05:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:05:55 [DEBUG   ] Got command BAM from MCS: ref #7789
2021-03-31 20:05:55 [INFO    ] Finished processing BAM request
2021-03-31 20:05:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:05:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7789   8 59304 72355033 A  ERROR'
2021-03-31 20:05:55 [DEBUG   ] Got command BAM from MCS: ref #7790
2021-03-31 20:05:55 [INFO    ] Finished processing BAM request
2021-03-31 20:05:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:05:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7790   8 59304 72355037 A  ERROR'
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-03-31 20:05:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-03-31 20:05:55 [DEBUG   ] spawn_process: at 2021-03-31 20:05:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-03-31 20:05:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:06:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 20:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:06:06 [DEBUG   ] Finished updating board flags in 1.350 seconds
2021-03-31 20:06:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:06:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:06:44 [DEBUG   ] Got command BAM from MCS: ref #7792
2021-03-31 20:06:44 [INFO    ] Finished processing BAM request
2021-03-31 20:06:44 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7792   8 59304 72404025 A  ERROR'
2021-03-31 20:06:44 [DEBUG   ] Got command BAM from MCS: ref #7791
2021-03-31 20:06:44 [INFO    ] Finished processing BAM request
2021-03-31 20:06:44 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:06:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7791   8 59304 72404029 A  ERROR'
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 20:06:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 20:06:44 [DEBUG   ] spawn_process: at 2021-03-31 20:06:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 20:06:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:07:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-03-31 20:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:07:06 [DEBUG   ] Finished updating board flags in 1.187 seconds
2021-03-31 20:07:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:07:33 [DEBUG   ] Got command BAM from MCS: ref #7799
2021-03-31 20:07:33 [INFO    ] Finished processing BAM request
2021-03-31 20:07:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7799   8 59304 72453029 A  ERROR'
2021-03-31 20:07:33 [DEBUG   ] Got command BAM from MCS: ref #7800
2021-03-31 20:07:33 [INFO    ] Finished processing BAM request
2021-03-31 20:07:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-03-31 20:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7800   8 59304 72453033 A  ERROR'
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-03-31 20:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-03-31 20:07:33 [DEBUG   ] spawn_process: at 2021-03-31 20:07:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-03-31 20:07:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:07:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 20:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:08:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-03-31 20:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:08:06 [DEBUG   ] Finished updating board flags in 1.020 seconds
2021-03-31 20:08:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 20:08:21 [DEBUG   ] Got command STP from MCS: ref #7801
2021-03-31 20:08:21 [INFO    ] Finished processing BAM request
2021-03-31 20:08:21 [INFO    ] Shutdown the adder chain on beam #3
2021-03-31 20:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP     7801   8 59304 72501852 A  ERROR'
2021-03-31 20:08:21 [DEBUG   ] Got command STP from MCS: ref #7802
2021-03-31 20:08:21 [INFO    ] Finished processing BAM request
2021-03-31 20:08:21 [INFO    ] Shutdown the adder chain on beam #4
2021-03-31 20:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP     7802   8 59304 72501856 A  ERROR'
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-03-31 20:08:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-03-31 20:08:21 [DEBUG   ] spawn_process: at 2021-03-31 20:08:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-03-31 20:08:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 20:08:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:09:06 [DEBUG   ] Finished updating board flags in 0.986 seconds
2021-03-31 20:09:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:09:20 [DEBUG   ] Got command RPT from MCS: ref #7803
2021-03-31 20:09:20 [DEBUG   ] summary = ERROR
2021-03-31 20:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7803  13 59304 72560317 A  ERRORERROR'
2021-03-31 20:09:20 [DEBUG   ] Got command RPT from MCS: ref #7804
2021-03-31 20:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7804  77 59304 72560317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:09:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:09:44 [DEBUG   ] Got command RPT from MCS: ref #7825
2021-03-31 20:09:44 [DEBUG   ] summary = ERROR
2021-03-31 20:09:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7825  13 59304 72584437 A  ERRORERROR'
2021-03-31 20:09:44 [DEBUG   ] Got command RPT from MCS: ref #7827
2021-03-31 20:09:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:09:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7827  77 59304 72584641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:09:44 [DEBUG   ] Got command RPT from MCS: ref #7829
2021-03-31 20:09:44 [DEBUG   ] summary = ERROR
2021-03-31 20:09:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7829  13 59304 72584845 A  ERRORERROR'
2021-03-31 20:09:45 [DEBUG   ] Got command RPT from MCS: ref #7831
2021-03-31 20:09:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7831  77 59304 72585037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:09:45 [DEBUG   ] Got command RPT from MCS: ref #7832
2021-03-31 20:09:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7832  12 59304 72585241 A  ERRORB›™š'
2021-03-31 20:09:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:10:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:10:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:10:07 [DEBUG   ] Finished updating board flags in 1.834 seconds
2021-03-31 20:10:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:10:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:10:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:11:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:11:06 [DEBUG   ] Finished updating board flags in 1.213 seconds
2021-03-31 20:11:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:11:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:11:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:12:06 [DEBUG   ] Finished updating board flags in 1.282 seconds
2021-03-31 20:12:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:12:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:12:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:13:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:13:06 [DEBUG   ] Finished updating board flags in 1.120 seconds
2021-03-31 20:13:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:13:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:13:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:14:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:14:06 [DEBUG   ] Finished updating board flags in 1.033 seconds
2021-03-31 20:14:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:14:20 [DEBUG   ] Got command RPT from MCS: ref #7844
2021-03-31 20:14:20 [DEBUG   ] summary = ERROR
2021-03-31 20:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7844  13 59304 72860321 A  ERRORERROR'
2021-03-31 20:14:20 [DEBUG   ] Got command RPT from MCS: ref #7845
2021-03-31 20:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7845  77 59304 72860321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:14:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:14:44 [DEBUG   ] Got command RPT from MCS: ref #7861
2021-03-31 20:14:44 [DEBUG   ] summary = ERROR
2021-03-31 20:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7861  13 59304 72884513 A  ERRORERROR'
2021-03-31 20:14:44 [DEBUG   ] Got command RPT from MCS: ref #7862
2021-03-31 20:14:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7862  77 59304 72884705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:14:44 [DEBUG   ] Got command RPT from MCS: ref #7863
2021-03-31 20:14:44 [DEBUG   ] summary = ERROR
2021-03-31 20:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7863  13 59304 72884909 A  ERRORERROR'
2021-03-31 20:14:45 [DEBUG   ] Got command RPT from MCS: ref #7864
2021-03-31 20:14:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:14:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7864  77 59304 72885113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:14:45 [DEBUG   ] Got command RPT from MCS: ref #7865
2021-03-31 20:14:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:14:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7865  12 59304 72885317 A  ERRORB–™š'
2021-03-31 20:14:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:15:07 [DEBUG   ] Finished updating board flags in 1.548 seconds
2021-03-31 20:15:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:15:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:15:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:16:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:16:07 [DEBUG   ] Finished updating board flags in 1.396 seconds
2021-03-31 20:16:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:16:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:16:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:17:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:17:07 [DEBUG   ] Finished updating board flags in 1.243 seconds
2021-03-31 20:17:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:17:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:17:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-03-31 20:18:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:18:07 [DEBUG   ] Finished updating board flags in 1.171 seconds
2021-03-31 20:18:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:18:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:18:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:19:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:19:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:19:08 [DEBUG   ] Finished updating board flags in 2.016 seconds
2021-03-31 20:19:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 20:19:20 [DEBUG   ] Got command RPT from MCS: ref #7878
2021-03-31 20:19:20 [DEBUG   ] summary = ERROR
2021-03-31 20:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7878  13 59304 73160321 A  ERRORERROR'
2021-03-31 20:19:20 [DEBUG   ] Got command RPT from MCS: ref #7879
2021-03-31 20:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7879  77 59304 73160321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:19:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 20:19:44 [DEBUG   ] Got command RPT from MCS: ref #7897
2021-03-31 20:19:44 [DEBUG   ] summary = ERROR
2021-03-31 20:19:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7897  13 59304 73184585 A  ERRORERROR'
2021-03-31 20:19:44 [DEBUG   ] Got command RPT from MCS: ref #7898
2021-03-31 20:19:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:19:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7898  77 59304 73184777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:19:44 [DEBUG   ] Got command RPT from MCS: ref #7899
2021-03-31 20:19:44 [DEBUG   ] summary = ERROR
2021-03-31 20:19:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7899  13 59304 73184981 A  ERRORERROR'
2021-03-31 20:19:45 [DEBUG   ] Got command RPT from MCS: ref #7900
2021-03-31 20:19:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7900  77 59304 73185185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:19:45 [DEBUG   ] Got command RPT from MCS: ref #7901
2021-03-31 20:19:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7901  12 59304 73185377 A  ERRORB–™š'
2021-03-31 20:19:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 20:20:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:20:07 [DEBUG   ] Finished updating board flags in 1.408 seconds
2021-03-31 20:20:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 20:20:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 20:20:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 20:21:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:21:07 [DEBUG   ] Finished updating board flags in 1.440 seconds
2021-03-31 20:21:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 20:21:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:21:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:22:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:22:07 [DEBUG   ] Finished updating board flags in 1.368 seconds
2021-03-31 20:22:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:22:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:22:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-03-31 20:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:23:07 [DEBUG   ] Finished updating board flags in 1.229 seconds
2021-03-31 20:23:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:23:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:23:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 20:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:24:08 [DEBUG   ] Finished updating board flags in 1.749 seconds
2021-03-31 20:24:19 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-03-31 20:24:20 [DEBUG   ] Got command RPT from MCS: ref #7913
2021-03-31 20:24:20 [DEBUG   ] summary = ERROR
2021-03-31 20:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7913  13 59304 73460321 A  ERRORERROR'
2021-03-31 20:24:20 [DEBUG   ] Got command RPT from MCS: ref #7914
2021-03-31 20:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7914  77 59304 73460321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:24:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:24:44 [DEBUG   ] Got command RPT from MCS: ref #7933
2021-03-31 20:24:44 [DEBUG   ] summary = ERROR
2021-03-31 20:24:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7933  13 59304 73484649 A  ERRORERROR'
2021-03-31 20:24:44 [DEBUG   ] Got command RPT from MCS: ref #7935
2021-03-31 20:24:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:24:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7935  77 59304 73484853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:24:45 [DEBUG   ] Got command RPT from MCS: ref #7937
2021-03-31 20:24:45 [DEBUG   ] summary = ERROR
2021-03-31 20:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7937  13 59304 73485045 A  ERRORERROR'
2021-03-31 20:24:45 [DEBUG   ] Got command RPT from MCS: ref #7939
2021-03-31 20:24:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7939  77 59304 73485249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:24:45 [DEBUG   ] Got command RPT from MCS: ref #7940
2021-03-31 20:24:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7940  12 59304 73485453 A  ERRORB˜™š'
2021-03-31 20:25:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:25:08 [DEBUG   ] Finished updating board flags in 1.578 seconds
2021-03-31 20:25:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:25:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:26:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:26:08 [DEBUG   ] Finished updating board flags in 1.413 seconds
2021-03-31 20:26:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:26:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:27:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:27:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:27:08 [DEBUG   ] Finished updating board flags in 1.467 seconds
2021-03-31 20:27:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:27:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:28:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:28:08 [DEBUG   ] Finished updating board flags in 1.324 seconds
2021-03-31 20:28:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:28:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:29:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:29:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:29:08 [DEBUG   ] Finished updating board flags in 1.227 seconds
2021-03-31 20:29:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:29:20 [DEBUG   ] Got command RPT from MCS: ref #7947
2021-03-31 20:29:20 [DEBUG   ] summary = ERROR
2021-03-31 20:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7947  13 59304 73760325 A  ERRORERROR'
2021-03-31 20:29:20 [DEBUG   ] Got command RPT from MCS: ref #7948
2021-03-31 20:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7948  77 59304 73760325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:29:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:29:44 [DEBUG   ] Got command RPT from MCS: ref #7966
2021-03-31 20:29:44 [DEBUG   ] summary = ERROR
2021-03-31 20:29:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7966  13 59304 73784717 A  ERRORERROR'
2021-03-31 20:29:44 [DEBUG   ] Got command RPT from MCS: ref #7967
2021-03-31 20:29:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:29:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7967  77 59304 73784921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:29:45 [DEBUG   ] Got command RPT from MCS: ref #7968
2021-03-31 20:29:45 [DEBUG   ] summary = ERROR
2021-03-31 20:29:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7968  13 59304 73785113 A  ERRORERROR'
2021-03-31 20:29:45 [DEBUG   ] Got command RPT from MCS: ref #7969
2021-03-31 20:29:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:29:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7969  77 59304 73785317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:29:45 [DEBUG   ] Got command RPT from MCS: ref #7970
2021-03-31 20:29:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:29:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7970  12 59304 73785521 A  ERRORB˜™š'
2021-03-31 20:30:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:30:08 [DEBUG   ] Finished updating board flags in 1.211 seconds
2021-03-31 20:30:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:30:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:31:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:31:08 [DEBUG   ] Finished updating board flags in 1.175 seconds
2021-03-31 20:31:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:31:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:32:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:32:08 [DEBUG   ] Finished updating board flags in 1.048 seconds
2021-03-31 20:32:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:32:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:33:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:33:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:33:09 [DEBUG   ] Finished updating board flags in 2.028 seconds
2021-03-31 20:33:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:33:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:34:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:34:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:34:09 [DEBUG   ] Finished updating board flags in 2.009 seconds
2021-03-31 20:34:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 20:34:20 [DEBUG   ] Got command RPT from MCS: ref #7988
2021-03-31 20:34:20 [DEBUG   ] summary = ERROR
2021-03-31 20:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7988  13 59304 74060329 A  ERRORERROR'
2021-03-31 20:34:20 [DEBUG   ] Got command RPT from MCS: ref #7989
2021-03-31 20:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7989  77 59304 74060329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:34:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:34:44 [DEBUG   ] Got command RPT from MCS: ref #8005
2021-03-31 20:34:44 [DEBUG   ] summary = ERROR
2021-03-31 20:34:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8005  13 59304 74084785 A  ERRORERROR'
2021-03-31 20:34:44 [DEBUG   ] Got command RPT from MCS: ref #8006
2021-03-31 20:34:44 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:34:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8006  77 59304 74084989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:34:45 [DEBUG   ] Got command RPT from MCS: ref #8007
2021-03-31 20:34:45 [DEBUG   ] summary = ERROR
2021-03-31 20:34:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8007  13 59304 74085181 A  ERRORERROR'
2021-03-31 20:34:45 [DEBUG   ] Got command RPT from MCS: ref #8008
2021-03-31 20:34:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:34:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8008  77 59304 74085385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:34:45 [DEBUG   ] Got command RPT from MCS: ref #8009
2021-03-31 20:34:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:34:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8009  12 59304 74085589 A  ERRORB˜™š'
2021-03-31 20:35:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:35:09 [DEBUG   ] Finished updating board flags in 1.932 seconds
2021-03-31 20:35:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:35:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:36:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:36:08 [DEBUG   ] Finished updating board flags in 1.250 seconds
2021-03-31 20:36:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:36:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:37:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:37:08 [DEBUG   ] Finished updating board flags in 1.218 seconds
2021-03-31 20:37:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:37:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:38:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:38:08 [DEBUG   ] Finished updating board flags in 1.207 seconds
2021-03-31 20:38:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:38:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:39:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 20:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:39:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:39:08 [DEBUG   ] Finished updating board flags in 1.194 seconds
2021-03-31 20:39:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 20:39:20 [DEBUG   ] Got command RPT from MCS: ref #8016
2021-03-31 20:39:20 [DEBUG   ] summary = ERROR
2021-03-31 20:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8016  13 59304 74360329 A  ERRORERROR'
2021-03-31 20:39:20 [DEBUG   ] Got command RPT from MCS: ref #8017
2021-03-31 20:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8017  77 59304 74360329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:39:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:39:44 [DEBUG   ] Got command RPT from MCS: ref #8038
2021-03-31 20:39:44 [DEBUG   ] summary = ERROR
2021-03-31 20:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8038  13 59304 74384849 A  ERRORERROR'
2021-03-31 20:39:45 [DEBUG   ] Got command RPT from MCS: ref #8040
2021-03-31 20:39:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:39:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8040  77 59304 74385053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:39:45 [DEBUG   ] Got command RPT from MCS: ref #8042
2021-03-31 20:39:45 [DEBUG   ] summary = ERROR
2021-03-31 20:39:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8042  13 59304 74385257 A  ERRORERROR'
2021-03-31 20:39:45 [DEBUG   ] Got command RPT from MCS: ref #8044
2021-03-31 20:39:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:39:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8044  77 59304 74385449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:39:45 [DEBUG   ] Got command RPT from MCS: ref #8045
2021-03-31 20:39:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:39:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8045  12 59304 74385653 A  ERRORB—™š'
2021-03-31 20:40:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:40:09 [DEBUG   ] Finished updating board flags in 1.610 seconds
2021-03-31 20:40:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:40:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:41:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:41:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:41:08 [DEBUG   ] Finished updating board flags in 0.976 seconds
2021-03-31 20:41:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:41:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 20:42:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 20:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:42:09 [DEBUG   ] Finished updating board flags in 1.367 seconds
2021-03-31 20:42:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 20:42:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 20:43:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:43:09 [DEBUG   ] Finished updating board flags in 1.184 seconds
2021-03-31 20:43:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:43:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:44:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:44:09 [DEBUG   ] Finished updating board flags in 1.014 seconds
2021-03-31 20:44:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:44:20 [DEBUG   ] Got command RPT from MCS: ref #8057
2021-03-31 20:44:20 [DEBUG   ] summary = ERROR
2021-03-31 20:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8057  13 59304 74660329 A  ERRORERROR'
2021-03-31 20:44:20 [DEBUG   ] Got command RPT from MCS: ref #8058
2021-03-31 20:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8058  77 59304 74660329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:44:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:44:44 [DEBUG   ] Got command RPT from MCS: ref #8074
2021-03-31 20:44:44 [DEBUG   ] summary = ERROR
2021-03-31 20:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8074  13 59304 74684921 A  ERRORERROR'
2021-03-31 20:44:45 [DEBUG   ] Got command RPT from MCS: ref #8075
2021-03-31 20:44:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:44:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8075  77 59304 74685125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:44:45 [DEBUG   ] Got command RPT from MCS: ref #8076
2021-03-31 20:44:45 [DEBUG   ] summary = ERROR
2021-03-31 20:44:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8076  13 59304 74685329 A  ERRORERROR'
2021-03-31 20:44:45 [DEBUG   ] Got command RPT from MCS: ref #8077
2021-03-31 20:44:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:44:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8077  77 59304 74685521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:44:45 [DEBUG   ] Got command RPT from MCS: ref #8078
2021-03-31 20:44:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:44:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8078  12 59304 74685725 A  ERRORB—™š'
2021-03-31 20:45:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:45:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:45:09 [DEBUG   ] Finished updating board flags in 0.997 seconds
2021-03-31 20:45:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:45:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:46:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:46:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:46:10 [DEBUG   ] Finished updating board flags in 1.855 seconds
2021-03-31 20:46:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:46:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:47:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:47:10 [DEBUG   ] Finished updating board flags in 1.770 seconds
2021-03-31 20:47:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:47:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:48:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:48:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:48:09 [DEBUG   ] Finished updating board flags in 1.046 seconds
2021-03-31 20:48:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:48:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:49:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:49:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:49:09 [DEBUG   ] Finished updating board flags in 1.015 seconds
2021-03-31 20:49:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:49:20 [DEBUG   ] Got command RPT from MCS: ref #8091
2021-03-31 20:49:20 [DEBUG   ] summary = ERROR
2021-03-31 20:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8091  13 59304 74960325 A  ERRORERROR'
2021-03-31 20:49:20 [DEBUG   ] Got command RPT from MCS: ref #8092
2021-03-31 20:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8092  77 59304 74960325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:49:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:49:44 [DEBUG   ] Got command RPT from MCS: ref #8110
2021-03-31 20:49:44 [DEBUG   ] summary = ERROR
2021-03-31 20:49:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8110  13 59304 74984985 A  ERRORERROR'
2021-03-31 20:49:45 [DEBUG   ] Got command RPT from MCS: ref #8111
2021-03-31 20:49:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:49:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8111  77 59304 74985189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:49:45 [DEBUG   ] Got command RPT from MCS: ref #8112
2021-03-31 20:49:45 [DEBUG   ] summary = ERROR
2021-03-31 20:49:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8112  13 59304 74985393 A  ERRORERROR'
2021-03-31 20:49:45 [DEBUG   ] Got command RPT from MCS: ref #8113
2021-03-31 20:49:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:49:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8113  77 59304 74985597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:49:45 [DEBUG   ] Got command RPT from MCS: ref #8114
2021-03-31 20:49:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:49:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8114  12 59304 74985789 A  ERRORB—™š'
2021-03-31 20:50:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:50:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:50:09 [DEBUG   ] Finished updating board flags in 0.963 seconds
2021-03-31 20:50:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:50:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:51:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:51:10 [DEBUG   ] Finished updating board flags in 1.386 seconds
2021-03-31 20:51:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:51:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:52:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:52:10 [DEBUG   ] Finished updating board flags in 1.226 seconds
2021-03-31 20:52:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:52:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:53:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:53:10 [DEBUG   ] Finished updating board flags in 1.217 seconds
2021-03-31 20:53:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:53:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:54:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:54:10 [DEBUG   ] Finished updating board flags in 1.142 seconds
2021-03-31 20:54:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:54:20 [DEBUG   ] Got command RPT from MCS: ref #8126
2021-03-31 20:54:20 [DEBUG   ] summary = ERROR
2021-03-31 20:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8126  13 59304 75260325 A  ERRORERROR'
2021-03-31 20:54:20 [DEBUG   ] Got command RPT from MCS: ref #8127
2021-03-31 20:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8127  77 59304 75260325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:54:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:54:45 [DEBUG   ] Got command RPT from MCS: ref #8146
2021-03-31 20:54:45 [DEBUG   ] summary = ERROR
2021-03-31 20:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8146  13 59304 75285057 A  ERRORERROR'
2021-03-31 20:54:45 [DEBUG   ] Got command RPT from MCS: ref #8148
2021-03-31 20:54:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8148  77 59304 75285261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:54:45 [DEBUG   ] Got command RPT from MCS: ref #8150
2021-03-31 20:54:45 [DEBUG   ] summary = ERROR
2021-03-31 20:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8150  13 59304 75285465 A  ERRORERROR'
2021-03-31 20:54:45 [DEBUG   ] Got command RPT from MCS: ref #8152
2021-03-31 20:54:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8152  77 59304 75285657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:54:45 [DEBUG   ] Got command RPT from MCS: ref #8153
2021-03-31 20:54:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8153  12 59304 75285861 A  ERRORB—™š'
2021-03-31 20:55:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:55:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:55:10 [DEBUG   ] Finished updating board flags in 1.026 seconds
2021-03-31 20:55:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:55:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:56:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:56:00 [DEBUG   ] Got command TBN from MCS: ref #8154
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] tbn = exited with status True, code 0x00
2021-03-31 20:56:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     8154   8 59304 75360849 A  ERROR'
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1617224162']
2021-03-31 20:56:00 [DEBUG   ] spawn_process: at 2021-03-31 20:56:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1617224162']
2021-03-31 20:56:00 [INFO    ] Finished spawning TBN in 0.048 s
2021-03-31 20:56:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:56:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:56:11 [DEBUG   ] Finished updating board flags in 2.228 seconds
2021-03-31 20:56:20 [DEBUG   ] Finished updating ant stats in 0.866 seconds
2021-03-31 20:56:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:57:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 20:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:57:11 [DEBUG   ] Finished updating board flags in 2.217 seconds
2021-03-31 20:57:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 20:57:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 20:58:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 20:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:58:11 [DEBUG   ] Finished updating board flags in 2.145 seconds
2021-03-31 20:58:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2021-03-31 20:58:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 20:59:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 20:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 20:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 20:59:11 [DEBUG   ] Finished updating board flags in 2.018 seconds
2021-03-31 20:59:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 20:59:20 [DEBUG   ] Got command RPT from MCS: ref #8161
2021-03-31 20:59:20 [DEBUG   ] summary = ERROR
2021-03-31 20:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8161  13 59304 75560325 A  ERRORERROR'
2021-03-31 20:59:20 [DEBUG   ] Got command RPT from MCS: ref #8162
2021-03-31 20:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8162  77 59304 75560325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:59:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 20:59:45 [DEBUG   ] Got command RPT from MCS: ref #8180
2021-03-31 20:59:45 [DEBUG   ] summary = ERROR
2021-03-31 20:59:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8180  13 59304 75585129 A  ERRORERROR'
2021-03-31 20:59:45 [DEBUG   ] Got command RPT from MCS: ref #8181
2021-03-31 20:59:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:59:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8181  77 59304 75585333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:59:45 [DEBUG   ] Got command RPT from MCS: ref #8182
2021-03-31 20:59:45 [DEBUG   ] summary = ERROR
2021-03-31 20:59:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8182  13 59304 75585525 A  ERRORERROR'
2021-03-31 20:59:45 [DEBUG   ] Got command RPT from MCS: ref #8183
2021-03-31 20:59:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 20:59:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8183  77 59304 75585729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 20:59:45 [DEBUG   ] Got command RPT from MCS: ref #8184
2021-03-31 20:59:45 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 20:59:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8184  12 59304 75585933 A  ERRORB–™š'
2021-03-31 21:00:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 21:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:00:11 [DEBUG   ] Finished updating board flags in 2.070 seconds
2021-03-31 21:00:11 [DEBUG   ] Got command TBW from MCS: ref #8191
2021-03-31 21:00:11 [DEBUG   ] tbw = exited with status True, code 0x00
2021-03-31 21:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW     8191   8 59304 75611933 A  ERROR'
2021-03-31 21:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2021-03-31 21:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2021-03-31 21:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2021-03-31 21:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2021-03-31 21:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2021-03-31 21:00:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2021-03-31 21:00:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2021-03-31 21:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2021-03-31 21:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2021-03-31 21:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2021-03-31 21:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2021-03-31 21:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2021-03-31 21:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2021-03-31 21:00:15 [DEBUG   ] spawn_process: at 2021-03-31 21:00:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2021-03-31 21:00:15 [INFO    ] Finished spawning TBW
2021-03-31 21:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:01:11 [DEBUG   ] Finished updating board flags in 1.806 seconds
2021-03-31 21:02:03 [INFO    ] __waitForTBW - TBW finished in 108.363 s
2021-03-31 21:02:04 [DEBUG   ] Finished updating ant stats in 0.469 seconds
2021-03-31 21:02:04 [INFO    ] Started antennas statistics background thread
2021-03-31 21:02:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1617224526']
2021-03-31 21:02:04 [DEBUG   ] spawn_process: at 2021-03-31 21:02:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1617224526']
2021-03-31 21:02:04 [INFO    ] Finished spawning TBN in 0.048 s
2021-03-31 21:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:02:11 [DEBUG   ] Finished updating board flags in 1.984 seconds
2021-03-31 21:02:24 [DEBUG   ] Finished updating ant stats in 0.471 seconds
2021-03-31 21:02:44 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 21:03:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 21:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:03:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:03:11 [DEBUG   ] Finished updating board flags in 1.753 seconds
2021-03-31 21:03:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 21:03:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:04:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 21:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:04:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:04:11 [DEBUG   ] Finished updating board flags in 1.611 seconds
2021-03-31 21:04:20 [DEBUG   ] Got command RPT from MCS: ref #8211
2021-03-31 21:04:20 [DEBUG   ] summary = ERROR
2021-03-31 21:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8211  13 59304 75860333 A  ERRORERROR'
2021-03-31 21:04:20 [DEBUG   ] Got command RPT from MCS: ref #8212
2021-03-31 21:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8212  77 59304 75860333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:04:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 21:04:45 [DEBUG   ] Got command RPT from MCS: ref #8228
2021-03-31 21:04:45 [DEBUG   ] summary = ERROR
2021-03-31 21:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8228  13 59304 75885217 A  ERRORERROR'
2021-03-31 21:04:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:04:45 [DEBUG   ] Got command RPT from MCS: ref #8229
2021-03-31 21:04:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8229  77 59304 75885409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:04:45 [DEBUG   ] Got command RPT from MCS: ref #8230
2021-03-31 21:04:45 [DEBUG   ] summary = ERROR
2021-03-31 21:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8230  13 59304 75885613 A  ERRORERROR'
2021-03-31 21:04:45 [DEBUG   ] Got command RPT from MCS: ref #8231
2021-03-31 21:04:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8231  77 59304 75885817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:04:46 [DEBUG   ] Got command RPT from MCS: ref #8232
2021-03-31 21:04:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:04:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8232  12 59304 75886021 A  ERRORB–™š'
2021-03-31 21:05:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:05:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:05:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:05:11 [DEBUG   ] Finished updating board flags in 1.577 seconds
2021-03-31 21:05:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 21:05:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 21:06:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 21:06:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:06:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:06:11 [DEBUG   ] Finished updating board flags in 1.404 seconds
2021-03-31 21:06:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 21:06:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 21:07:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 21:07:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:07:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:07:11 [DEBUG   ] Finished updating board flags in 1.459 seconds
2021-03-31 21:07:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:07:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:08:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2021-03-31 21:08:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:08:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:08:11 [DEBUG   ] Finished updating board flags in 1.409 seconds
2021-03-31 21:08:25 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2021-03-31 21:08:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 21:09:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 21:09:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:09:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:09:11 [DEBUG   ] Finished updating board flags in 1.418 seconds
2021-03-31 21:09:20 [DEBUG   ] Got command RPT from MCS: ref #8239
2021-03-31 21:09:20 [DEBUG   ] summary = ERROR
2021-03-31 21:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8239  13 59304 76160333 A  ERRORERROR'
2021-03-31 21:09:20 [DEBUG   ] Got command RPT from MCS: ref #8240
2021-03-31 21:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8240  77 59304 76160333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:09:26 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2021-03-31 21:09:45 [DEBUG   ] Got command RPT from MCS: ref #8261
2021-03-31 21:09:45 [DEBUG   ] summary = ERROR
2021-03-31 21:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8261  13 59304 76185329 A  ERRORERROR'
2021-03-31 21:09:45 [DEBUG   ] Got command RPT from MCS: ref #8263
2021-03-31 21:09:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8263  77 59304 76185533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:09:45 [DEBUG   ] Got command RPT from MCS: ref #8265
2021-03-31 21:09:45 [DEBUG   ] summary = ERROR
2021-03-31 21:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8265  13 59304 76185737 A  ERRORERROR'
2021-03-31 21:09:45 [DEBUG   ] Got command RPT from MCS: ref #8267
2021-03-31 21:09:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:09:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8267  77 59304 76185929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:09:46 [DEBUG   ] Got command RPT from MCS: ref #8269
2021-03-31 21:09:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8269  12 59304 76186133 A  ERRORB–™š'
2021-03-31 21:09:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 21:10:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 21:10:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:10:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:10:11 [DEBUG   ] Finished updating board flags in 1.419 seconds
2021-03-31 21:10:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 21:10:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 21:11:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:11:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-03-31 21:11:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:11:11 [DEBUG   ] Finished updating board flags in 1.414 seconds
2021-03-31 21:11:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:11:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 21:12:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 21:12:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:12:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:12:11 [DEBUG   ] Finished updating board flags in 1.419 seconds
2021-03-31 21:12:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 21:12:46 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2021-03-31 21:13:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 21:13:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:13:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:13:11 [DEBUG   ] Finished updating board flags in 1.455 seconds
2021-03-31 21:13:26 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2021-03-31 21:13:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 21:14:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 21:14:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:14:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:14:11 [DEBUG   ] Finished updating board flags in 1.425 seconds
2021-03-31 21:14:20 [DEBUG   ] Got command RPT from MCS: ref #8280
2021-03-31 21:14:20 [DEBUG   ] summary = ERROR
2021-03-31 21:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8280  13 59304 76460337 A  ERRORERROR'
2021-03-31 21:14:20 [DEBUG   ] Got command RPT from MCS: ref #8281
2021-03-31 21:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8281  77 59304 76460337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:14:27 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2021-03-31 21:14:45 [DEBUG   ] Got command RPT from MCS: ref #8297
2021-03-31 21:14:45 [DEBUG   ] summary = ERROR
2021-03-31 21:14:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8297  13 59304 76485405 A  ERRORERROR'
2021-03-31 21:14:45 [DEBUG   ] Got command RPT from MCS: ref #8298
2021-03-31 21:14:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:14:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8298  77 59304 76485609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:14:45 [DEBUG   ] Got command RPT from MCS: ref #8299
2021-03-31 21:14:45 [DEBUG   ] summary = ERROR
2021-03-31 21:14:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8299  13 59304 76485801 A  ERRORERROR'
2021-03-31 21:14:46 [DEBUG   ] Got command RPT from MCS: ref #8300
2021-03-31 21:14:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8300  77 59304 76486005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:14:46 [DEBUG   ] Got command RPT from MCS: ref #8301
2021-03-31 21:14:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8301  12 59304 76486209 A  ERRORB™™š'
2021-03-31 21:14:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 21:15:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 21:15:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:15:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:15:11 [DEBUG   ] Finished updating board flags in 1.428 seconds
2021-03-31 21:15:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 21:15:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 21:16:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:16:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:16:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:16:12 [DEBUG   ] Finished updating board flags in 2.245 seconds
2021-03-31 21:16:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 21:16:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 21:17:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 21:17:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:17:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:17:12 [DEBUG   ] Finished updating board flags in 2.132 seconds
2021-03-31 21:17:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 21:17:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 21:18:07 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2021-03-31 21:18:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:18:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:18:12 [DEBUG   ] Finished updating board flags in 2.021 seconds
2021-03-31 21:18:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:18:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 21:19:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 21:19:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:19:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:19:12 [DEBUG   ] Finished updating board flags in 1.976 seconds
2021-03-31 21:19:20 [DEBUG   ] Got command RPT from MCS: ref #8324
2021-03-31 21:19:20 [DEBUG   ] summary = ERROR
2021-03-31 21:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8324  13 59304 76760329 A  ERRORERROR'
2021-03-31 21:19:20 [DEBUG   ] Got command RPT from MCS: ref #8325
2021-03-31 21:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8325  77 59304 76760329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:19:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 21:19:45 [DEBUG   ] Got command RPT from MCS: ref #8343
2021-03-31 21:19:45 [DEBUG   ] summary = ERROR
2021-03-31 21:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8343  13 59304 76785469 A  ERRORERROR'
2021-03-31 21:19:45 [DEBUG   ] Got command RPT from MCS: ref #8344
2021-03-31 21:19:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8344  77 59304 76785673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:19:45 [DEBUG   ] Got command RPT from MCS: ref #8345
2021-03-31 21:19:45 [DEBUG   ] summary = ERROR
2021-03-31 21:19:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8345  13 59304 76785877 A  ERRORERROR'
2021-03-31 21:19:46 [DEBUG   ] Got command RPT from MCS: ref #8346
2021-03-31 21:19:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:19:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8346  77 59304 76786069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:19:46 [DEBUG   ] Got command RPT from MCS: ref #8348
2021-03-31 21:19:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:19:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8348  12 59304 76786273 A  ERRORB™™š'
2021-03-31 21:19:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 21:20:07 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 21:20:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:20:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:20:12 [DEBUG   ] Finished updating board flags in 1.822 seconds
2021-03-31 21:20:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 21:20:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 21:21:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:21:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:21:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:21:12 [DEBUG   ] Finished updating board flags in 1.782 seconds
2021-03-31 21:21:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 21:21:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:22:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:22:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:22:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:22:12 [DEBUG   ] Finished updating board flags in 1.624 seconds
2021-03-31 21:22:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:22:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 21:23:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 21:23:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:23:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:23:12 [DEBUG   ] Finished updating board flags in 1.613 seconds
2021-03-31 21:23:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:23:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:24:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 21:24:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:24:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:24:12 [DEBUG   ] Finished updating board flags in 1.576 seconds
2021-03-31 21:24:20 [DEBUG   ] Got command RPT from MCS: ref #8359
2021-03-31 21:24:20 [DEBUG   ] summary = ERROR
2021-03-31 21:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8359  13 59304 77060341 A  ERRORERROR'
2021-03-31 21:24:20 [DEBUG   ] Got command RPT from MCS: ref #8360
2021-03-31 21:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8360  77 59304 77060341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:24:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:24:45 [DEBUG   ] Got command RPT from MCS: ref #8379
2021-03-31 21:24:45 [DEBUG   ] summary = ERROR
2021-03-31 21:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8379  13 59304 77085545 A  ERRORERROR'
2021-03-31 21:24:45 [DEBUG   ] Got command RPT from MCS: ref #8381
2021-03-31 21:24:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8381  77 59304 77085749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:24:45 [DEBUG   ] Got command RPT from MCS: ref #8383
2021-03-31 21:24:45 [DEBUG   ] summary = ERROR
2021-03-31 21:24:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8383  13 59304 77085941 A  ERRORERROR'
2021-03-31 21:24:46 [DEBUG   ] Got command RPT from MCS: ref #8385
2021-03-31 21:24:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8385  77 59304 77086145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:24:46 [DEBUG   ] Got command RPT from MCS: ref #8386
2021-03-31 21:24:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8386  12 59304 77086349 A  ERRORB˜™š'
2021-03-31 21:24:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 21:25:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:25:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:25:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:25:12 [DEBUG   ] Finished updating board flags in 1.446 seconds
2021-03-31 21:25:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 21:25:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:26:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 21:26:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:26:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:26:12 [DEBUG   ] Finished updating board flags in 1.538 seconds
2021-03-31 21:26:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 21:26:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 21:27:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 21:27:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:27:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:27:12 [DEBUG   ] Finished updating board flags in 1.553 seconds
2021-03-31 21:27:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 21:27:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 21:28:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 21:28:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:28:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:28:13 [DEBUG   ] Finished updating board flags in 2.164 seconds
2021-03-31 21:28:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 21:28:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:29:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 21:29:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:29:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:29:13 [DEBUG   ] Finished updating board flags in 2.033 seconds
2021-03-31 21:29:20 [DEBUG   ] Got command RPT from MCS: ref #8393
2021-03-31 21:29:20 [DEBUG   ] summary = ERROR
2021-03-31 21:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8393  13 59304 77360337 A  ERRORERROR'
2021-03-31 21:29:20 [DEBUG   ] Got command RPT from MCS: ref #8394
2021-03-31 21:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8394  77 59304 77360337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:29:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 21:29:45 [DEBUG   ] Got command RPT from MCS: ref #8412
2021-03-31 21:29:45 [DEBUG   ] summary = ERROR
2021-03-31 21:29:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8412  13 59304 77385609 A  ERRORERROR'
2021-03-31 21:29:45 [DEBUG   ] Got command RPT from MCS: ref #8413
2021-03-31 21:29:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:29:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8413  77 59304 77385813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:29:46 [DEBUG   ] Got command RPT from MCS: ref #8414
2021-03-31 21:29:46 [DEBUG   ] summary = ERROR
2021-03-31 21:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8414  13 59304 77386017 A  ERRORERROR'
2021-03-31 21:29:46 [DEBUG   ] Got command RPT from MCS: ref #8415
2021-03-31 21:29:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8415  77 59304 77386209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:29:46 [DEBUG   ] Got command RPT from MCS: ref #8417
2021-03-31 21:29:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8417  12 59304 77386413 A  ERRORB˜™š'
2021-03-31 21:29:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 21:30:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:30:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:30:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:30:13 [DEBUG   ] Finished updating board flags in 1.890 seconds
2021-03-31 21:30:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:30:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 21:31:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 21:31:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:31:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:31:13 [DEBUG   ] Finished updating board flags in 1.793 seconds
2021-03-31 21:31:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 21:31:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 21:32:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:32:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:32:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:32:13 [DEBUG   ] Finished updating board flags in 1.594 seconds
2021-03-31 21:32:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:32:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:33:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 21:33:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:33:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:33:13 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 21:33:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 21:33:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 21:34:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 21:34:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:34:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:34:13 [DEBUG   ] Finished updating board flags in 1.411 seconds
2021-03-31 21:34:20 [DEBUG   ] Got command RPT from MCS: ref #8434
2021-03-31 21:34:20 [DEBUG   ] summary = ERROR
2021-03-31 21:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8434  13 59304 77660341 A  ERRORERROR'
2021-03-31 21:34:20 [DEBUG   ] Got command RPT from MCS: ref #8435
2021-03-31 21:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8435  77 59304 77660341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:34:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2021-03-31 21:34:45 [DEBUG   ] Got command RPT from MCS: ref #8451
2021-03-31 21:34:45 [DEBUG   ] summary = ERROR
2021-03-31 21:34:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8451  13 59304 77685677 A  ERRORERROR'
2021-03-31 21:34:45 [DEBUG   ] Got command RPT from MCS: ref #8452
2021-03-31 21:34:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:34:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8452  77 59304 77685881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:34:46 [DEBUG   ] Got command RPT from MCS: ref #8453
2021-03-31 21:34:46 [DEBUG   ] summary = ERROR
2021-03-31 21:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8453  13 59304 77686085 A  ERRORERROR'
2021-03-31 21:34:46 [DEBUG   ] Got command RPT from MCS: ref #8454
2021-03-31 21:34:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8454  77 59304 77686277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:34:46 [DEBUG   ] Got command RPT from MCS: ref #8455
2021-03-31 21:34:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8455  12 59304 77686507 A  ERRORB—™š'
2021-03-31 21:34:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 21:35:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:35:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:35:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:35:13 [DEBUG   ] Finished updating board flags in 1.380 seconds
2021-03-31 21:35:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 21:35:50 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2021-03-31 21:36:10 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2021-03-31 21:36:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:36:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:36:13 [DEBUG   ] Finished updating board flags in 1.352 seconds
2021-03-31 21:36:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:36:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 21:37:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 21:37:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:37:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:37:14 [DEBUG   ] Finished updating board flags in 2.072 seconds
2021-03-31 21:37:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:37:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:38:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 21:38:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:38:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:38:14 [DEBUG   ] Finished updating board flags in 1.984 seconds
2021-03-31 21:38:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:38:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:39:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:39:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:39:14 [DEBUG   ] Finished updating board flags in 1.879 seconds
2021-03-31 21:39:20 [DEBUG   ] Got command RPT from MCS: ref #8462
2021-03-31 21:39:20 [DEBUG   ] summary = ERROR
2021-03-31 21:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8462  13 59304 77960337 A  ERRORERROR'
2021-03-31 21:39:20 [DEBUG   ] Got command RPT from MCS: ref #8463
2021-03-31 21:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8463  77 59304 77960337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:39:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 21:39:45 [DEBUG   ] Got command RPT from MCS: ref #8484
2021-03-31 21:39:45 [DEBUG   ] summary = ERROR
2021-03-31 21:39:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8484  13 59304 77985753 A  ERRORERROR'
2021-03-31 21:39:45 [DEBUG   ] Got command RPT from MCS: ref #8486
2021-03-31 21:39:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:39:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8486  77 59304 77985945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:39:46 [DEBUG   ] Got command RPT from MCS: ref #8488
2021-03-31 21:39:46 [DEBUG   ] summary = ERROR
2021-03-31 21:39:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8488  13 59304 77986149 A  ERRORERROR'
2021-03-31 21:39:46 [DEBUG   ] Got command RPT from MCS: ref #8490
2021-03-31 21:39:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:39:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8490  77 59304 77986353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:39:46 [DEBUG   ] Got command RPT from MCS: ref #8492
2021-03-31 21:39:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:39:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8492  12 59304 77986545 A  ERRORB—™š'
2021-03-31 21:39:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:40:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:40:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:40:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:40:14 [DEBUG   ] Finished updating board flags in 1.764 seconds
2021-03-31 21:40:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:40:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 21:41:10 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 21:41:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:41:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:41:14 [DEBUG   ] Finished updating board flags in 1.603 seconds
2021-03-31 21:41:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 21:41:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:42:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 21:42:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:42:14 [DEBUG   ] Finished updating board flags in 1.566 seconds
2021-03-31 21:42:30 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 21:42:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 21:43:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 21:43:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:43:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:43:14 [DEBUG   ] Finished updating board flags in 1.408 seconds
2021-03-31 21:43:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 21:43:50 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2021-03-31 21:44:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 21:44:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:44:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:44:14 [DEBUG   ] Finished updating board flags in 1.393 seconds
2021-03-31 21:44:20 [DEBUG   ] Got command RPT from MCS: ref #8503
2021-03-31 21:44:20 [DEBUG   ] summary = ERROR
2021-03-31 21:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8503  13 59304 78260337 A  ERRORERROR'
2021-03-31 21:44:20 [DEBUG   ] Got command RPT from MCS: ref #8504
2021-03-31 21:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8504  77 59304 78260337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:44:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 21:44:45 [DEBUG   ] Got command RPT from MCS: ref #8520
2021-03-31 21:44:45 [DEBUG   ] summary = ERROR
2021-03-31 21:44:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8520  13 59304 78285817 A  ERRORERROR'
2021-03-31 21:44:46 [DEBUG   ] Got command RPT from MCS: ref #8521
2021-03-31 21:44:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:44:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8521  77 59304 78286021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:44:46 [DEBUG   ] Got command RPT from MCS: ref #8522
2021-03-31 21:44:46 [DEBUG   ] summary = ERROR
2021-03-31 21:44:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8522  13 59304 78286225 A  ERRORERROR'
2021-03-31 21:44:46 [DEBUG   ] Got command RPT from MCS: ref #8523
2021-03-31 21:44:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:44:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8523  77 59304 78286417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:44:46 [DEBUG   ] Got command RPT from MCS: ref #8524
2021-03-31 21:44:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:44:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8524  12 59304 78286621 A  ERRORB–™š'
2021-03-31 21:44:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 21:45:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 21:45:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:45:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:45:14 [DEBUG   ] Finished updating board flags in 1.370 seconds
2021-03-31 21:45:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 21:45:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 21:46:10 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2021-03-31 21:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:46:15 [DEBUG   ] Finished updating board flags in 2.051 seconds
2021-03-31 21:46:31 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-03-31 21:46:51 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 21:47:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 21:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:47:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:47:15 [DEBUG   ] Finished updating board flags in 1.987 seconds
2021-03-31 21:47:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 21:47:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 21:48:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 21:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:48:15 [DEBUG   ] Finished updating board flags in 1.812 seconds
2021-03-31 21:48:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:48:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 21:49:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:49:15 [DEBUG   ] Finished updating board flags in 1.803 seconds
2021-03-31 21:49:20 [DEBUG   ] Got command RPT from MCS: ref #8537
2021-03-31 21:49:20 [DEBUG   ] summary = ERROR
2021-03-31 21:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8537  13 59304 78560341 A  ERRORERROR'
2021-03-31 21:49:20 [DEBUG   ] Got command RPT from MCS: ref #8538
2021-03-31 21:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8538  77 59304 78560341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:49:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 21:49:45 [DEBUG   ] Got command RPT from MCS: ref #8556
2021-03-31 21:49:45 [DEBUG   ] summary = ERROR
2021-03-31 21:49:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8556  13 59304 78585889 A  ERRORERROR'
2021-03-31 21:49:46 [DEBUG   ] Got command RPT from MCS: ref #8557
2021-03-31 21:49:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8557  77 59304 78586093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:49:46 [DEBUG   ] Got command RPT from MCS: ref #8558
2021-03-31 21:49:46 [DEBUG   ] summary = ERROR
2021-03-31 21:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8558  13 59304 78586285 A  ERRORERROR'
2021-03-31 21:49:46 [DEBUG   ] Got command RPT from MCS: ref #8559
2021-03-31 21:49:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8559  77 59304 78586493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:49:46 [DEBUG   ] Got command RPT from MCS: ref #8561
2021-03-31 21:49:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8561  12 59304 78586697 A  ERRORB–™š'
2021-03-31 21:49:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 21:50:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-03-31 21:50:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:50:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:50:15 [DEBUG   ] Finished updating board flags in 1.820 seconds
2021-03-31 21:50:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 21:50:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 21:51:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 21:51:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:51:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:51:15 [DEBUG   ] Finished updating board flags in 1.787 seconds
2021-03-31 21:51:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 21:51:51 [DEBUG   ] Finished updating ant stats in 0.507 seconds
2021-03-31 21:52:12 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 21:52:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:52:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:52:15 [DEBUG   ] Finished updating board flags in 1.622 seconds
2021-03-31 21:52:32 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 21:52:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:53:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:53:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:53:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:53:15 [DEBUG   ] Finished updating board flags in 1.569 seconds
2021-03-31 21:53:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 21:53:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 21:54:13 [DEBUG   ] Finished updating ant stats in 2.204 seconds
2021-03-31 21:54:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:54:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:54:15 [DEBUG   ] Finished updating board flags in 1.413 seconds
2021-03-31 21:54:20 [DEBUG   ] Got command RPT from MCS: ref #8572
2021-03-31 21:54:20 [DEBUG   ] summary = ERROR
2021-03-31 21:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8572  13 59304 78860345 A  ERRORERROR'
2021-03-31 21:54:20 [DEBUG   ] Got command RPT from MCS: ref #8573
2021-03-31 21:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8573  77 59304 78860345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:54:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 21:54:45 [DEBUG   ] Got command RPT from MCS: ref #8592
2021-03-31 21:54:45 [DEBUG   ] summary = ERROR
2021-03-31 21:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8592  13 59304 78885965 A  ERRORERROR'
2021-03-31 21:54:46 [DEBUG   ] Got command RPT from MCS: ref #8594
2021-03-31 21:54:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:54:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8594  77 59304 78886157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:54:46 [DEBUG   ] Got command RPT from MCS: ref #8596
2021-03-31 21:54:46 [DEBUG   ] summary = ERROR
2021-03-31 21:54:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8596  13 59304 78886686 A  ERRORERROR'
2021-03-31 21:54:46 [DEBUG   ] Got command RPT from MCS: ref #8598
2021-03-31 21:54:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:54:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8598  77 59304 78886686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:54:46 [DEBUG   ] Got command RPT from MCS: ref #8599
2021-03-31 21:54:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:54:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8599  12 59304 78886769 A  ERRORB–™š'
2021-03-31 21:54:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 21:55:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 21:55:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:55:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:55:15 [DEBUG   ] Finished updating board flags in 1.562 seconds
2021-03-31 21:55:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 21:55:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 21:56:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 21:56:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:56:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:56:15 [DEBUG   ] Finished updating board flags in 1.579 seconds
2021-03-31 21:56:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:56:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 21:57:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 21:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:57:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:57:16 [DEBUG   ] Finished updating board flags in 2.140 seconds
2021-03-31 21:57:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:57:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:58:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 21:58:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:58:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:58:16 [DEBUG   ] Finished updating board flags in 2.007 seconds
2021-03-31 21:58:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 21:58:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 21:59:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 21:59:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 21:59:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 21:59:16 [DEBUG   ] Finished updating board flags in 1.913 seconds
2021-03-31 21:59:20 [DEBUG   ] Got command RPT from MCS: ref #8606
2021-03-31 21:59:20 [DEBUG   ] summary = ERROR
2021-03-31 21:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8606  13 59304 79160337 A  ERRORERROR'
2021-03-31 21:59:20 [DEBUG   ] Got command RPT from MCS: ref #8607
2021-03-31 21:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8607  77 59304 79160337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:59:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 21:59:46 [DEBUG   ] Got command RPT from MCS: ref #8625
2021-03-31 21:59:46 [DEBUG   ] summary = ERROR
2021-03-31 21:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8625  13 59304 79186029 A  ERRORERROR'
2021-03-31 21:59:46 [DEBUG   ] Got command RPT from MCS: ref #8626
2021-03-31 21:59:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8626  77 59304 79186233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:59:46 [DEBUG   ] Got command RPT from MCS: ref #8627
2021-03-31 21:59:46 [DEBUG   ] summary = ERROR
2021-03-31 21:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8627  13 59304 79186437 A  ERRORERROR'
2021-03-31 21:59:46 [DEBUG   ] Got command RPT from MCS: ref #8628
2021-03-31 21:59:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 21:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8628  77 59304 79186629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 21:59:46 [DEBUG   ] Got command RPT from MCS: ref #8630
2021-03-31 21:59:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 21:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8630  12 59304 79186833 A  ERRORB–™š'
2021-03-31 21:59:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:00:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:00:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:00:16 [DEBUG   ] Finished updating board flags in 1.811 seconds
2021-03-31 22:00:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:00:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 22:01:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:01:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:01:16 [DEBUG   ] Finished updating board flags in 1.816 seconds
2021-03-31 22:01:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:01:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:02:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 22:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:02:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:02:16 [DEBUG   ] Finished updating board flags in 1.814 seconds
2021-03-31 22:02:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:02:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:03:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:03:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:03:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:03:16 [DEBUG   ] Finished updating board flags in 1.850 seconds
2021-03-31 22:03:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:03:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:04:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:04:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:04:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:04:16 [DEBUG   ] Finished updating board flags in 1.832 seconds
2021-03-31 22:04:20 [DEBUG   ] Got command RPT from MCS: ref #8647
2021-03-31 22:04:20 [DEBUG   ] summary = ERROR
2021-03-31 22:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8647  13 59304 79460349 A  ERRORERROR'
2021-03-31 22:04:20 [DEBUG   ] Got command RPT from MCS: ref #8648
2021-03-31 22:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8648  77 59304 79460349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:04:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 22:04:46 [DEBUG   ] Got command RPT from MCS: ref #8664
2021-03-31 22:04:46 [DEBUG   ] summary = ERROR
2021-03-31 22:04:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8664  13 59304 79486101 A  ERRORERROR'
2021-03-31 22:04:46 [DEBUG   ] Got command RPT from MCS: ref #8665
2021-03-31 22:04:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:04:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8665  77 59304 79486305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:04:46 [DEBUG   ] Got command RPT from MCS: ref #8666
2021-03-31 22:04:46 [DEBUG   ] summary = ERROR
2021-03-31 22:04:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8666  13 59304 79486509 A  ERRORERROR'
2021-03-31 22:04:46 [DEBUG   ] Got command RPT from MCS: ref #8667
2021-03-31 22:04:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:04:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8667  77 59304 79486701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:04:46 [DEBUG   ] Got command RPT from MCS: ref #8668
2021-03-31 22:04:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:04:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8668  12 59304 79486905 A  ERRORB–™š'
2021-03-31 22:04:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 22:05:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 22:05:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:05:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:05:16 [DEBUG   ] Finished updating board flags in 1.700 seconds
2021-03-31 22:05:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:05:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:06:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 22:06:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:06:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-03-31 22:06:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:06:16 [DEBUG   ] Finished updating board flags in 1.601 seconds
2021-03-31 22:06:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:06:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:07:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:07:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:07:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:07:16 [DEBUG   ] Finished updating board flags in 1.590 seconds
2021-03-31 22:07:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 22:07:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 22:08:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:08:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:08:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:08:16 [DEBUG   ] Finished updating board flags in 1.404 seconds
2021-03-31 22:08:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:08:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 22:09:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 22:09:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:09:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:09:16 [DEBUG   ] Finished updating board flags in 1.437 seconds
2021-03-31 22:09:20 [DEBUG   ] Got command RPT from MCS: ref #8675
2021-03-31 22:09:20 [DEBUG   ] summary = ERROR
2021-03-31 22:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8675  13 59304 79760349 A  ERRORERROR'
2021-03-31 22:09:20 [DEBUG   ] Got command RPT from MCS: ref #8676
2021-03-31 22:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8676  77 59304 79760349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:09:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 22:09:46 [DEBUG   ] Got command RPT from MCS: ref #8697
2021-03-31 22:09:46 [DEBUG   ] summary = ERROR
2021-03-31 22:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8697  13 59304 79786177 A  ERRORERROR'
2021-03-31 22:09:46 [DEBUG   ] Got command RPT from MCS: ref #8699
2021-03-31 22:09:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8699  77 59304 79786381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:09:46 [DEBUG   ] Got command RPT from MCS: ref #8701
2021-03-31 22:09:46 [DEBUG   ] summary = ERROR
2021-03-31 22:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8701  13 59304 79786573 A  ERRORERROR'
2021-03-31 22:09:46 [DEBUG   ] Got command RPT from MCS: ref #8703
2021-03-31 22:09:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8703  77 59304 79786777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:09:46 [DEBUG   ] Got command RPT from MCS: ref #8705
2021-03-31 22:09:46 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:09:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8705  12 59304 79786981 A  ERRORB–™š'
2021-03-31 22:09:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 22:10:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 22:10:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:10:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:10:16 [DEBUG   ] Finished updating board flags in 1.402 seconds
2021-03-31 22:10:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:10:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:11:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 22:11:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:11:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:11:16 [DEBUG   ] Finished updating board flags in 1.353 seconds
2021-03-31 22:11:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 22:11:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:12:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 22:12:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:12:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:12:16 [DEBUG   ] Finished updating board flags in 1.358 seconds
2021-03-31 22:12:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 22:12:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:13:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:13:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:13:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:13:17 [DEBUG   ] Finished updating board flags in 2.071 seconds
2021-03-31 22:13:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 22:13:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 22:14:14 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-03-31 22:14:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:14:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:14:17 [DEBUG   ] Finished updating board flags in 2.017 seconds
2021-03-31 22:14:20 [DEBUG   ] Got command RPT from MCS: ref #8716
2021-03-31 22:14:20 [DEBUG   ] summary = ERROR
2021-03-31 22:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8716  13 59304 80060341 A  ERRORERROR'
2021-03-31 22:14:20 [DEBUG   ] Got command RPT from MCS: ref #8717
2021-03-31 22:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8717  77 59304 80060341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:14:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:14:46 [DEBUG   ] Got command RPT from MCS: ref #8733
2021-03-31 22:14:46 [DEBUG   ] summary = ERROR
2021-03-31 22:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8733  13 59304 80086249 A  ERRORERROR'
2021-03-31 22:14:46 [DEBUG   ] Got command RPT from MCS: ref #8734
2021-03-31 22:14:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8734  77 59304 80086453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:14:46 [DEBUG   ] Got command RPT from MCS: ref #8735
2021-03-31 22:14:46 [DEBUG   ] summary = ERROR
2021-03-31 22:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8735  13 59304 80086645 A  ERRORERROR'
2021-03-31 22:14:46 [DEBUG   ] Got command RPT from MCS: ref #8736
2021-03-31 22:14:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:14:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8736  77 59304 80086849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:14:47 [DEBUG   ] Got command RPT from MCS: ref #8737
2021-03-31 22:14:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8737  12 59304 80087053 A  ERRORB–™š'
2021-03-31 22:14:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:15:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 22:15:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:15:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:15:17 [DEBUG   ] Finished updating board flags in 1.971 seconds
2021-03-31 22:15:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 22:15:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:16:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 22:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:16:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:16:17 [DEBUG   ] Finished updating board flags in 1.810 seconds
2021-03-31 22:16:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 22:16:54 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2021-03-31 22:17:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 22:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:17:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:17:17 [DEBUG   ] Finished updating board flags in 1.795 seconds
2021-03-31 22:17:35 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 22:17:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 22:18:15 [DEBUG   ] Finished updating ant stats in 1.182 seconds
2021-03-31 22:18:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:18:17 [DEBUG   ] Finished updating board flags in 1.602 seconds
2021-03-31 22:18:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 22:18:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 22:19:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:19:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:19:17 [DEBUG   ] Finished updating board flags in 1.614 seconds
2021-03-31 22:19:20 [DEBUG   ] Got command RPT from MCS: ref #8750
2021-03-31 22:19:20 [DEBUG   ] summary = ERROR
2021-03-31 22:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8750  13 59304 80360341 A  ERRORERROR'
2021-03-31 22:19:20 [DEBUG   ] Got command RPT from MCS: ref #8751
2021-03-31 22:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8751  77 59304 80360341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:19:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-03-31 22:19:46 [DEBUG   ] Got command RPT from MCS: ref #8769
2021-03-31 22:19:46 [DEBUG   ] summary = ERROR
2021-03-31 22:19:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8769  13 59304 80386321 A  ERRORERROR'
2021-03-31 22:19:46 [DEBUG   ] Got command RPT from MCS: ref #8770
2021-03-31 22:19:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:19:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8770  77 59304 80386525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:19:46 [DEBUG   ] Got command RPT from MCS: ref #8771
2021-03-31 22:19:46 [DEBUG   ] summary = ERROR
2021-03-31 22:19:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8771  13 59304 80386717 A  ERRORERROR'
2021-03-31 22:19:46 [DEBUG   ] Got command RPT from MCS: ref #8772
2021-03-31 22:19:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:19:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8772  77 59304 80386921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:19:47 [DEBUG   ] Got command RPT from MCS: ref #8774
2021-03-31 22:19:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8774  12 59304 80387125 A  ERRORB–™š'
2021-03-31 22:19:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 22:20:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 22:20:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:20:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:20:17 [DEBUG   ] Finished updating board flags in 1.598 seconds
2021-03-31 22:20:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:20:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 22:21:15 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 22:21:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:21:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:21:17 [DEBUG   ] Finished updating board flags in 1.398 seconds
2021-03-31 22:21:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 22:21:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 22:22:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 22:22:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:22:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:22:17 [DEBUG   ] Finished updating board flags in 1.403 seconds
2021-03-31 22:22:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 22:22:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:23:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:23:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:23:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:23:17 [DEBUG   ] Finished updating board flags in 1.337 seconds
2021-03-31 22:23:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:23:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:24:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:24:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:24:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:24:18 [DEBUG   ] Finished updating board flags in 2.139 seconds
2021-03-31 22:24:20 [DEBUG   ] Got command RPT from MCS: ref #8785
2021-03-31 22:24:20 [DEBUG   ] summary = ERROR
2021-03-31 22:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8785  13 59304 80660353 A  ERRORERROR'
2021-03-31 22:24:20 [DEBUG   ] Got command RPT from MCS: ref #8786
2021-03-31 22:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8786  77 59304 80660353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:24:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:24:46 [DEBUG   ] Got command RPT from MCS: ref #8805
2021-03-31 22:24:46 [DEBUG   ] summary = ERROR
2021-03-31 22:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8805  13 59304 80686393 A  ERRORERROR'
2021-03-31 22:24:46 [DEBUG   ] Got command RPT from MCS: ref #8807
2021-03-31 22:24:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8807  77 59304 80686597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:24:46 [DEBUG   ] Got command RPT from MCS: ref #8809
2021-03-31 22:24:46 [DEBUG   ] summary = ERROR
2021-03-31 22:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8809  13 59304 80686789 A  ERRORERROR'
2021-03-31 22:24:46 [DEBUG   ] Got command RPT from MCS: ref #8811
2021-03-31 22:24:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:24:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8811  77 59304 80686993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:24:47 [DEBUG   ] Got command RPT from MCS: ref #8812
2021-03-31 22:24:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:24:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8812  12 59304 80687197 A  ERRORB–™š'
2021-03-31 22:24:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:25:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:25:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:25:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:25:18 [DEBUG   ] Finished updating board flags in 2.036 seconds
2021-03-31 22:25:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:25:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:26:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 22:26:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:26:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:26:18 [DEBUG   ] Finished updating board flags in 2.028 seconds
2021-03-31 22:26:36 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2021-03-31 22:26:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:27:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:27:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:27:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:27:18 [DEBUG   ] Finished updating board flags in 1.864 seconds
2021-03-31 22:27:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 22:27:56 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 22:28:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:28:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:28:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:28:18 [DEBUG   ] Finished updating board flags in 1.813 seconds
2021-03-31 22:28:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:28:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:29:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:29:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:29:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:29:18 [DEBUG   ] Finished updating board flags in 1.801 seconds
2021-03-31 22:29:20 [DEBUG   ] Got command RPT from MCS: ref #8819
2021-03-31 22:29:20 [DEBUG   ] summary = ERROR
2021-03-31 22:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8819  13 59304 80960349 A  ERRORERROR'
2021-03-31 22:29:20 [DEBUG   ] Got command RPT from MCS: ref #8820
2021-03-31 22:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8820  77 59304 80960349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:29:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:29:46 [DEBUG   ] Got command RPT from MCS: ref #8838
2021-03-31 22:29:46 [DEBUG   ] summary = ERROR
2021-03-31 22:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8838  13 59304 80986465 A  ERRORERROR'
2021-03-31 22:29:46 [DEBUG   ] Got command RPT from MCS: ref #8839
2021-03-31 22:29:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8839  77 59304 80986669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:29:46 [DEBUG   ] Got command RPT from MCS: ref #8840
2021-03-31 22:29:46 [DEBUG   ] summary = ERROR
2021-03-31 22:29:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8840  13 59304 80986873 A  ERRORERROR'
2021-03-31 22:29:47 [DEBUG   ] Got command RPT from MCS: ref #8841
2021-03-31 22:29:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8841  77 59304 80987065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:29:47 [DEBUG   ] Got command RPT from MCS: ref #8843
2021-03-31 22:29:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8843  12 59304 80987269 A  ERRORB–™š'
2021-03-31 22:29:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:30:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 22:30:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:30:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:30:18 [DEBUG   ] Finished updating board flags in 1.794 seconds
2021-03-31 22:30:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:30:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:31:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:31:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:31:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:31:18 [DEBUG   ] Finished updating board flags in 1.615 seconds
2021-03-31 22:31:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 22:31:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 22:32:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:32:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:32:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:32:18 [DEBUG   ] Finished updating board flags in 1.582 seconds
2021-03-31 22:32:36 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2021-03-31 22:32:57 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 22:33:17 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2021-03-31 22:33:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:33:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:33:18 [DEBUG   ] Finished updating board flags in 1.429 seconds
2021-03-31 22:33:37 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2021-03-31 22:33:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 22:34:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 22:34:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:34:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:34:18 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-03-31 22:34:20 [DEBUG   ] Got command RPT from MCS: ref #8860
2021-03-31 22:34:20 [DEBUG   ] summary = ERROR
2021-03-31 22:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8860  13 59304 81260353 A  ERRORERROR'
2021-03-31 22:34:20 [DEBUG   ] Got command RPT from MCS: ref #8861
2021-03-31 22:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8861  77 59304 81260353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:34:37 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2021-03-31 22:34:46 [DEBUG   ] Got command RPT from MCS: ref #8877
2021-03-31 22:34:46 [DEBUG   ] summary = ERROR
2021-03-31 22:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8877  13 59304 81286541 A  ERRORERROR'
2021-03-31 22:34:46 [DEBUG   ] Got command RPT from MCS: ref #8878
2021-03-31 22:34:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8878  77 59304 81286745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:34:46 [DEBUG   ] Got command RPT from MCS: ref #8879
2021-03-31 22:34:46 [DEBUG   ] summary = ERROR
2021-03-31 22:34:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8879  13 59304 81286937 A  ERRORERROR'
2021-03-31 22:34:47 [DEBUG   ] Got command RPT from MCS: ref #8880
2021-03-31 22:34:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:34:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8880  77 59304 81287141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:34:47 [DEBUG   ] Got command RPT from MCS: ref #8881
2021-03-31 22:34:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:34:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8881  12 59304 81287345 A  ERRORB—™š'
2021-03-31 22:34:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:35:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:35:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:35:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:35:18 [DEBUG   ] Finished updating board flags in 1.440 seconds
2021-03-31 22:35:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 22:35:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 22:36:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 22:36:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:36:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:36:18 [DEBUG   ] Finished updating board flags in 1.412 seconds
2021-03-31 22:36:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 22:36:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 22:37:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:37:18 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2021-03-31 22:37:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:37:18 [DEBUG   ] Finished updating board flags in 1.412 seconds
2021-03-31 22:37:38 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-03-31 22:37:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-03-31 22:38:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:38:18 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2021-03-31 22:38:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:38:18 [DEBUG   ] Finished updating board flags in 1.464 seconds
2021-03-31 22:38:38 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2021-03-31 22:38:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 22:39:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:39:18 [DEBUG   ] Finished updating ant stats in 1.042 seconds
2021-03-31 22:39:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:39:18 [DEBUG   ] Finished updating board flags in 1.470 seconds
2021-03-31 22:39:20 [DEBUG   ] Got command RPT from MCS: ref #8888
2021-03-31 22:39:20 [DEBUG   ] summary = ERROR
2021-03-31 22:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8888  13 59304 81560357 A  ERRORERROR'
2021-03-31 22:39:20 [DEBUG   ] Got command RPT from MCS: ref #8889
2021-03-31 22:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8889  77 59304 81560357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:39:38 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2021-03-31 22:39:46 [DEBUG   ] Got command RPT from MCS: ref #8910
2021-03-31 22:39:46 [DEBUG   ] summary = ERROR
2021-03-31 22:39:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8910  13 59304 81586613 A  ERRORERROR'
2021-03-31 22:39:46 [DEBUG   ] Got command RPT from MCS: ref #8912
2021-03-31 22:39:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:39:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8912  77 59304 81586817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:39:47 [DEBUG   ] Got command RPT from MCS: ref #8914
2021-03-31 22:39:47 [DEBUG   ] summary = ERROR
2021-03-31 22:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8914  13 59304 81587021 A  ERRORERROR'
2021-03-31 22:39:47 [DEBUG   ] Got command RPT from MCS: ref #8916
2021-03-31 22:39:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8916  77 59304 81587213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:39:47 [DEBUG   ] Got command RPT from MCS: ref #8918
2021-03-31 22:39:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8918  12 59304 81587417 A  ERRORB–™š'
2021-03-31 22:39:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:40:18 [DEBUG   ] Finished updating ant stats in 0.856 seconds
2021-03-31 22:40:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:40:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:40:19 [DEBUG   ] Finished updating board flags in 2.176 seconds
2021-03-31 22:40:38 [DEBUG   ] Finished updating ant stats in 0.745 seconds
2021-03-31 22:40:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:41:18 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2021-03-31 22:41:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:41:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:41:19 [DEBUG   ] Finished updating board flags in 2.009 seconds
2021-03-31 22:41:38 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2021-03-31 22:41:59 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 22:42:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:42:19 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2021-03-31 22:42:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:42:19 [DEBUG   ] Finished updating board flags in 2.046 seconds
2021-03-31 22:42:39 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2021-03-31 22:42:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:43:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:43:19 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2021-03-31 22:43:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:43:19 [DEBUG   ] Finished updating board flags in 2.009 seconds
2021-03-31 22:43:39 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2021-03-31 22:43:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 22:44:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:44:19 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2021-03-31 22:44:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:44:19 [DEBUG   ] Finished updating board flags in 1.982 seconds
2021-03-31 22:44:20 [DEBUG   ] Got command RPT from MCS: ref #8929
2021-03-31 22:44:20 [DEBUG   ] summary = ERROR
2021-03-31 22:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8929  13 59304 81860357 A  ERRORERROR'
2021-03-31 22:44:20 [DEBUG   ] Got command RPT from MCS: ref #8930
2021-03-31 22:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8930  77 59304 81860357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:44:39 [DEBUG   ] Finished updating ant stats in 0.562 seconds
2021-03-31 22:44:46 [DEBUG   ] Got command RPT from MCS: ref #8946
2021-03-31 22:44:46 [DEBUG   ] summary = ERROR
2021-03-31 22:44:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8946  13 59304 81886685 A  ERRORERROR'
2021-03-31 22:44:46 [DEBUG   ] Got command RPT from MCS: ref #8947
2021-03-31 22:44:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:44:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8947  77 59304 81886889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:44:47 [DEBUG   ] Got command RPT from MCS: ref #8948
2021-03-31 22:44:47 [DEBUG   ] summary = ERROR
2021-03-31 22:44:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8948  13 59304 81887093 A  ERRORERROR'
2021-03-31 22:44:47 [DEBUG   ] Got command RPT from MCS: ref #8949
2021-03-31 22:44:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:44:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8949  77 59304 81887285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:44:47 [DEBUG   ] Got command RPT from MCS: ref #8950
2021-03-31 22:44:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:44:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8950  12 59304 81887489 A  ERRORB—™š'
2021-03-31 22:45:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-03-31 22:45:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:45:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:45:19 [DEBUG   ] Finished updating board flags in 1.853 seconds
2021-03-31 22:45:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 22:45:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:46:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 22:46:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:46:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:46:19 [DEBUG   ] Finished updating board flags in 1.759 seconds
2021-03-31 22:46:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 22:46:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:47:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:47:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:47:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:47:19 [DEBUG   ] Finished updating board flags in 1.632 seconds
2021-03-31 22:47:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 22:47:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:48:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:48:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:48:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:48:19 [DEBUG   ] Finished updating board flags in 1.569 seconds
2021-03-31 22:48:20 [DEBUG   ] Finished updating ant stats in 0.985 seconds
2021-03-31 22:48:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:49:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:49:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:49:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:49:19 [DEBUG   ] Finished updating board flags in 1.455 seconds
2021-03-31 22:49:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-03-31 22:49:20 [DEBUG   ] Got command RPT from MCS: ref #8963
2021-03-31 22:49:20 [DEBUG   ] summary = ERROR
2021-03-31 22:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8963  13 59304 82160349 A  ERRORERROR'
2021-03-31 22:49:20 [DEBUG   ] Got command RPT from MCS: ref #8964
2021-03-31 22:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8964  77 59304 82160349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:49:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:49:46 [DEBUG   ] Got command RPT from MCS: ref #8982
2021-03-31 22:49:46 [DEBUG   ] summary = ERROR
2021-03-31 22:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8982  13 59304 82186753 A  ERRORERROR'
2021-03-31 22:49:46 [DEBUG   ] Got command RPT from MCS: ref #8983
2021-03-31 22:49:46 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:49:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8983  77 59304 82186957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:49:47 [DEBUG   ] Got command RPT from MCS: ref #8984
2021-03-31 22:49:47 [DEBUG   ] summary = ERROR
2021-03-31 22:49:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8984  13 59304 82187161 A  ERRORERROR'
2021-03-31 22:49:47 [DEBUG   ] Got command RPT from MCS: ref #8985
2021-03-31 22:49:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:49:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8985  77 59304 82187353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:49:47 [DEBUG   ] Got command RPT from MCS: ref #8987
2021-03-31 22:49:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:49:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8987  12 59304 82187557 A  ERRORB—™š'
2021-03-31 22:50:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 22:50:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:50:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:50:19 [DEBUG   ] Finished updating board flags in 1.500 seconds
2021-03-31 22:50:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 22:50:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:51:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:51:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:51:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:51:19 [DEBUG   ] Finished updating board flags in 1.512 seconds
2021-03-31 22:51:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 22:51:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 22:52:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:52:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:52:20 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2021-03-31 22:52:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:52:20 [DEBUG   ] Finished updating board flags in 2.203 seconds
2021-03-31 22:52:40 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2021-03-31 22:53:00 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-03-31 22:53:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:53:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:53:20 [DEBUG   ] Finished updating board flags in 2.132 seconds
2021-03-31 22:53:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:53:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 22:54:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 22:54:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:54:20 [DEBUG   ] Got command RPT from MCS: ref #8998
2021-03-31 22:54:20 [DEBUG   ] summary = ERROR
2021-03-31 22:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8998  13 59304 82460349 A  ERRORERROR'
2021-03-31 22:54:20 [DEBUG   ] Got command RPT from MCS: ref #8999
2021-03-31 22:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8999  77 59304 82460349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:54:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:54:20 [DEBUG   ] Finished updating board flags in 2.082 seconds
2021-03-31 22:54:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 22:54:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 22:54:46 [DEBUG   ] Got command RPT from MCS: ref #9018
2021-03-31 22:54:46 [DEBUG   ] summary = ERROR
2021-03-31 22:54:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9018  13 59304 82486821 A  ERRORERROR'
2021-03-31 22:54:47 [DEBUG   ] Got command RPT from MCS: ref #9020
2021-03-31 22:54:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9020  77 59304 82487025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:54:47 [DEBUG   ] Got command RPT from MCS: ref #9022
2021-03-31 22:54:47 [DEBUG   ] summary = ERROR
2021-03-31 22:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9022  13 59304 82487229 A  ERRORERROR'
2021-03-31 22:54:47 [DEBUG   ] Got command RPT from MCS: ref #9024
2021-03-31 22:54:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9024  77 59304 82487433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:54:47 [DEBUG   ] Got command RPT from MCS: ref #9025
2021-03-31 22:54:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9025  12 59304 82487625 A  ERRORB–™š'
2021-03-31 22:55:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 22:55:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:55:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:55:20 [DEBUG   ] Finished updating board flags in 1.923 seconds
2021-03-31 22:55:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 22:55:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 22:56:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2021-03-31 22:56:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:56:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:56:20 [DEBUG   ] Finished updating board flags in 1.808 seconds
2021-03-31 22:56:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 22:56:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 22:57:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:57:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:57:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:57:20 [DEBUG   ] Finished updating board flags in 1.777 seconds
2021-03-31 22:57:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 22:57:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 22:58:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 22:58:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:58:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:58:20 [DEBUG   ] Finished updating board flags in 1.614 seconds
2021-03-31 22:58:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:58:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 22:59:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2021-03-31 22:59:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 22:59:20 [DEBUG   ] Got command RPT from MCS: ref #9032
2021-03-31 22:59:20 [DEBUG   ] summary = ERROR
2021-03-31 22:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9032  13 59304 82760357 A  ERRORERROR'
2021-03-31 22:59:20 [DEBUG   ] Got command RPT from MCS: ref #9033
2021-03-31 22:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9033  77 59304 82760357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:59:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 22:59:20 [DEBUG   ] Finished updating board flags in 1.561 seconds
2021-03-31 22:59:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 22:59:41 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-03-31 22:59:46 [DEBUG   ] Got command RPT from MCS: ref #9051
2021-03-31 22:59:46 [DEBUG   ] summary = ERROR
2021-03-31 22:59:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9051  13 59304 82786897 A  ERRORERROR'
2021-03-31 22:59:47 [DEBUG   ] Got command RPT from MCS: ref #9052
2021-03-31 22:59:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9052  77 59304 82787101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:59:47 [DEBUG   ] Got command RPT from MCS: ref #9053
2021-03-31 22:59:47 [DEBUG   ] summary = ERROR
2021-03-31 22:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9053  13 59304 82787305 A  ERRORERROR'
2021-03-31 22:59:47 [DEBUG   ] Got command RPT from MCS: ref #9054
2021-03-31 22:59:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 22:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9054  77 59304 82787497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 22:59:47 [DEBUG   ] Got command RPT from MCS: ref #9056
2021-03-31 22:59:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 22:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9056  12 59304 82787701 A  ERRORB—™š'
2021-03-31 23:00:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-03-31 23:00:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:00:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:00:20 [DEBUG   ] Finished updating board flags in 1.423 seconds
2021-03-31 23:00:22 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2021-03-31 23:00:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 23:01:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:01:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:01:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2021-03-31 23:01:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:01:20 [DEBUG   ] Finished updating board flags in 1.378 seconds
2021-03-31 23:01:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:01:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 23:02:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:02:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:02:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:02:20 [DEBUG   ] Finished updating board flags in 1.513 seconds
2021-03-31 23:02:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:02:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 23:03:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:03:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:03:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:03:21 [DEBUG   ] Finished updating board flags in 2.158 seconds
2021-03-31 23:03:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:03:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:04:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 23:04:20 [DEBUG   ] Got command RPT from MCS: ref #9073
2021-03-31 23:04:20 [DEBUG   ] summary = ERROR
2021-03-31 23:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9073  13 59304 83060353 A  ERRORERROR'
2021-03-31 23:04:20 [DEBUG   ] Got command RPT from MCS: ref #9074
2021-03-31 23:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9074  77 59304 83060353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:04:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:04:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:04:21 [DEBUG   ] Finished updating board flags in 2.065 seconds
2021-03-31 23:04:22 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-03-31 23:04:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:04:46 [DEBUG   ] Got command RPT from MCS: ref #9090
2021-03-31 23:04:46 [DEBUG   ] summary = ERROR
2021-03-31 23:04:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9090  13 59304 83086977 A  ERRORERROR'
2021-03-31 23:04:47 [DEBUG   ] Got command RPT from MCS: ref #9091
2021-03-31 23:04:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:04:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9091  77 59304 83087169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:04:47 [DEBUG   ] Got command RPT from MCS: ref #9092
2021-03-31 23:04:47 [DEBUG   ] summary = ERROR
2021-03-31 23:04:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9092  13 59304 83087373 A  ERRORERROR'
2021-03-31 23:04:47 [DEBUG   ] Got command RPT from MCS: ref #9093
2021-03-31 23:04:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:04:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9093  77 59304 83087577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:04:47 [DEBUG   ] Got command RPT from MCS: ref #9094
2021-03-31 23:04:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:04:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9094  12 59304 83087769 A  ERRORB—™š'
2021-03-31 23:05:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 23:05:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:05:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:05:21 [DEBUG   ] Finished updating board flags in 1.916 seconds
2021-03-31 23:05:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 23:05:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 23:06:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 23:06:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:06:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:06:21 [DEBUG   ] Finished updating board flags in 1.832 seconds
2021-03-31 23:06:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 23:06:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 23:07:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:07:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:07:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:07:21 [DEBUG   ] Finished updating board flags in 1.800 seconds
2021-03-31 23:07:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 23:07:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 23:08:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 23:08:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:08:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:08:21 [DEBUG   ] Finished updating board flags in 1.648 seconds
2021-03-31 23:08:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:08:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:09:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 23:09:20 [DEBUG   ] Got command RPT from MCS: ref #9101
2021-03-31 23:09:20 [DEBUG   ] summary = ERROR
2021-03-31 23:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9101  13 59304 83360353 A  ERRORERROR'
2021-03-31 23:09:20 [DEBUG   ] Got command RPT from MCS: ref #9102
2021-03-31 23:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9102  77 59304 83360353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:09:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:09:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:09:21 [DEBUG   ] Finished updating board flags in 1.625 seconds
2021-03-31 23:09:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-03-31 23:09:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 23:09:47 [DEBUG   ] Got command RPT from MCS: ref #9123
2021-03-31 23:09:47 [DEBUG   ] summary = ERROR
2021-03-31 23:09:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9123  13 59304 83387049 A  ERRORERROR'
2021-03-31 23:09:47 [DEBUG   ] Got command RPT from MCS: ref #9125
2021-03-31 23:09:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:09:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9125  77 59304 83387241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:09:47 [DEBUG   ] Got command RPT from MCS: ref #9127
2021-03-31 23:09:47 [DEBUG   ] summary = ERROR
2021-03-31 23:09:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9127  13 59304 83387445 A  ERRORERROR'
2021-03-31 23:09:47 [DEBUG   ] Got command RPT from MCS: ref #9129
2021-03-31 23:09:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:09:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9129  77 59304 83387649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:09:47 [DEBUG   ] Got command RPT from MCS: ref #9131
2021-03-31 23:09:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:09:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9131  12 59304 83387841 A  ERRORB—™š'
2021-03-31 23:10:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 23:10:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:10:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:10:21 [DEBUG   ] Finished updating board flags in 1.507 seconds
2021-03-31 23:10:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 23:10:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 23:11:02 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2021-03-31 23:11:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:11:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:11:21 [DEBUG   ] Finished updating board flags in 1.471 seconds
2021-03-31 23:11:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 23:11:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 23:12:03 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 23:12:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:12:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:12:21 [DEBUG   ] Finished updating board flags in 1.465 seconds
2021-03-31 23:12:23 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-03-31 23:12:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 23:13:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-03-31 23:13:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:13:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:13:21 [DEBUG   ] Finished updating board flags in 1.475 seconds
2021-03-31 23:13:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-03-31 23:13:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 23:14:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 23:14:20 [DEBUG   ] Got command RPT from MCS: ref #9142
2021-03-31 23:14:20 [DEBUG   ] summary = ERROR
2021-03-31 23:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9142  13 59304 83660357 A  ERRORERROR'
2021-03-31 23:14:20 [DEBUG   ] Got command RPT from MCS: ref #9143
2021-03-31 23:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9143  77 59304 83660357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:14:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:14:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:14:22 [DEBUG   ] Finished updating board flags in 2.209 seconds
2021-03-31 23:14:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 23:14:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:14:47 [DEBUG   ] Got command RPT from MCS: ref #9159
2021-03-31 23:14:47 [DEBUG   ] summary = ERROR
2021-03-31 23:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9159  13 59304 83687117 A  ERRORERROR'
2021-03-31 23:14:47 [DEBUG   ] Got command RPT from MCS: ref #9160
2021-03-31 23:14:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9160  77 59304 83687321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:14:47 [DEBUG   ] Got command RPT from MCS: ref #9161
2021-03-31 23:14:47 [DEBUG   ] summary = ERROR
2021-03-31 23:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9161  13 59304 83687513 A  ERRORERROR'
2021-03-31 23:14:47 [DEBUG   ] Got command RPT from MCS: ref #9162
2021-03-31 23:14:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9162  77 59304 83687717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:14:47 [DEBUG   ] Got command RPT from MCS: ref #9163
2021-03-31 23:14:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9163  12 59304 83687921 A  ERRORB–™š'
2021-03-31 23:15:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 23:15:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:15:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:15:22 [DEBUG   ] Finished updating board flags in 2.150 seconds
2021-03-31 23:15:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 23:15:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:16:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:16:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:16:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:16:22 [DEBUG   ] Finished updating board flags in 2.035 seconds
2021-03-31 23:16:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:16:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:17:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:17:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:17:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:17:22 [DEBUG   ] Finished updating board flags in 1.962 seconds
2021-03-31 23:17:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:17:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:18:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:18:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:18:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:18:22 [DEBUG   ] Finished updating board flags in 1.819 seconds
2021-03-31 23:18:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:18:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:19:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:19:20 [DEBUG   ] Got command RPT from MCS: ref #9176
2021-03-31 23:19:20 [DEBUG   ] summary = ERROR
2021-03-31 23:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9176  13 59304 83960357 A  ERRORERROR'
2021-03-31 23:19:20 [DEBUG   ] Got command RPT from MCS: ref #9177
2021-03-31 23:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9177  77 59304 83960357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:19:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:19:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:19:22 [DEBUG   ] Finished updating board flags in 1.868 seconds
2021-03-31 23:19:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:19:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:19:47 [DEBUG   ] Got command RPT from MCS: ref #9195
2021-03-31 23:19:47 [DEBUG   ] summary = ERROR
2021-03-31 23:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9195  13 59304 83987189 A  ERRORERROR'
2021-03-31 23:19:47 [DEBUG   ] Got command RPT from MCS: ref #9196
2021-03-31 23:19:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9196  77 59304 83987393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:19:47 [DEBUG   ] Got command RPT from MCS: ref #9197
2021-03-31 23:19:47 [DEBUG   ] summary = ERROR
2021-03-31 23:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9197  13 59304 83987585 A  ERRORERROR'
2021-03-31 23:19:47 [DEBUG   ] Got command RPT from MCS: ref #9198
2021-03-31 23:19:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9198  77 59304 83987789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:19:47 [DEBUG   ] Got command RPT from MCS: ref #9200
2021-03-31 23:19:47 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:19:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9200  12 59304 83987993 A  ERRORB–™š'
2021-03-31 23:20:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:20:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:20:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:20:22 [DEBUG   ] Finished updating board flags in 1.723 seconds
2021-03-31 23:20:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:20:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 23:21:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 23:21:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:21:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:21:22 [DEBUG   ] Finished updating board flags in 1.633 seconds
2021-03-31 23:21:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 23:21:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-03-31 23:22:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:22:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:22:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:22:22 [DEBUG   ] Finished updating board flags in 1.560 seconds
2021-03-31 23:22:24 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2021-03-31 23:22:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:23:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 23:23:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:23:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:23:22 [DEBUG   ] Finished updating board flags in 1.432 seconds
2021-03-31 23:23:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:23:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 23:24:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 23:24:20 [DEBUG   ] Got command RPT from MCS: ref #9211
2021-03-31 23:24:20 [DEBUG   ] summary = ERROR
2021-03-31 23:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9211  13 59304 84260361 A  ERRORERROR'
2021-03-31 23:24:20 [DEBUG   ] Got command RPT from MCS: ref #9212
2021-03-31 23:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9212  77 59304 84260361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:24:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:24:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:24:22 [DEBUG   ] Finished updating board flags in 1.451 seconds
2021-03-31 23:24:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 23:24:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:24:47 [DEBUG   ] Got command RPT from MCS: ref #9231
2021-03-31 23:24:47 [DEBUG   ] summary = ERROR
2021-03-31 23:24:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9231  13 59304 84287261 A  ERRORERROR'
2021-03-31 23:24:47 [DEBUG   ] Got command RPT from MCS: ref #9233
2021-03-31 23:24:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:24:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9233  77 59304 84287465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:24:47 [DEBUG   ] Got command RPT from MCS: ref #9235
2021-03-31 23:24:47 [DEBUG   ] summary = ERROR
2021-03-31 23:24:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9235  13 59304 84287657 A  ERRORERROR'
2021-03-31 23:24:47 [DEBUG   ] Got command RPT from MCS: ref #9237
2021-03-31 23:24:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:24:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9237  77 59304 84287861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:24:48 [DEBUG   ] Got command RPT from MCS: ref #9238
2021-03-31 23:24:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9238  12 59304 84288065 A  ERRORB–™š'
2021-03-31 23:25:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 23:25:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:25:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:25:22 [DEBUG   ] Finished updating board flags in 1.471 seconds
2021-03-31 23:25:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:25:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 23:26:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 23:26:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:26:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:26:22 [DEBUG   ] Finished updating board flags in 1.472 seconds
2021-03-31 23:26:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 23:26:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 23:27:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 23:27:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:27:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:27:23 [DEBUG   ] Finished updating board flags in 2.276 seconds
2021-03-31 23:27:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-03-31 23:27:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 23:28:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:28:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:28:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:28:23 [DEBUG   ] Finished updating board flags in 2.139 seconds
2021-03-31 23:28:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:28:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:29:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:29:20 [DEBUG   ] Got command RPT from MCS: ref #9245
2021-03-31 23:29:20 [DEBUG   ] summary = ERROR
2021-03-31 23:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9245  13 59304 84560357 A  ERRORERROR'
2021-03-31 23:29:20 [DEBUG   ] Got command RPT from MCS: ref #9246
2021-03-31 23:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9246  77 59304 84560357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:29:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:29:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:29:23 [DEBUG   ] Finished updating board flags in 2.030 seconds
2021-03-31 23:29:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:29:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 23:29:47 [DEBUG   ] Got command RPT from MCS: ref #9264
2021-03-31 23:29:47 [DEBUG   ] summary = ERROR
2021-03-31 23:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9264  13 59304 84587333 A  ERRORERROR'
2021-03-31 23:29:47 [DEBUG   ] Got command RPT from MCS: ref #9265
2021-03-31 23:29:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9265  77 59304 84587537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:29:47 [DEBUG   ] Got command RPT from MCS: ref #9266
2021-03-31 23:29:47 [DEBUG   ] summary = ERROR
2021-03-31 23:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9266  13 59304 84587741 A  ERRORERROR'
2021-03-31 23:29:47 [DEBUG   ] Got command RPT from MCS: ref #9267
2021-03-31 23:29:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9267  77 59304 84587933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:29:48 [DEBUG   ] Got command RPT from MCS: ref #9269
2021-03-31 23:29:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:29:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9269  12 59304 84588137 A  ERRORB–™š'
2021-03-31 23:30:05 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2021-03-31 23:30:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:30:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:30:23 [DEBUG   ] Finished updating board flags in 1.967 seconds
2021-03-31 23:30:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 23:30:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:31:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:31:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:31:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:31:23 [DEBUG   ] Finished updating board flags in 1.812 seconds
2021-03-31 23:31:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:31:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:32:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 23:32:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:32:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:32:23 [DEBUG   ] Finished updating board flags in 1.814 seconds
2021-03-31 23:32:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:32:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:33:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:33:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:33:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:33:23 [DEBUG   ] Finished updating board flags in 1.870 seconds
2021-03-31 23:33:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 23:33:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-03-31 23:34:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-03-31 23:34:20 [DEBUG   ] Got command RPT from MCS: ref #9286
2021-03-31 23:34:20 [DEBUG   ] summary = ERROR
2021-03-31 23:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9286  13 59304 84860369 A  ERRORERROR'
2021-03-31 23:34:20 [DEBUG   ] Got command RPT from MCS: ref #9287
2021-03-31 23:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9287  77 59304 84860369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:34:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:34:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:34:23 [DEBUG   ] Finished updating board flags in 1.698 seconds
2021-03-31 23:34:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:34:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 23:34:47 [DEBUG   ] Got command RPT from MCS: ref #9303
2021-03-31 23:34:47 [DEBUG   ] summary = ERROR
2021-03-31 23:34:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9303  13 59304 84887409 A  ERRORERROR'
2021-03-31 23:34:47 [DEBUG   ] Got command RPT from MCS: ref #9304
2021-03-31 23:34:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:34:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9304  77 59304 84887601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:34:47 [DEBUG   ] Got command RPT from MCS: ref #9305
2021-03-31 23:34:47 [DEBUG   ] summary = ERROR
2021-03-31 23:34:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9305  13 59304 84887805 A  ERRORERROR'
2021-03-31 23:34:48 [DEBUG   ] Got command RPT from MCS: ref #9306
2021-03-31 23:34:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9306  77 59304 84888009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:34:48 [DEBUG   ] Got command RPT from MCS: ref #9307
2021-03-31 23:34:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9307  12 59304 84888213 A  ERRORB—™š'
2021-03-31 23:35:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-03-31 23:35:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:35:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:35:23 [DEBUG   ] Finished updating board flags in 1.634 seconds
2021-03-31 23:35:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 23:35:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 23:36:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-03-31 23:36:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:36:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:36:23 [DEBUG   ] Finished updating board flags in 1.576 seconds
2021-03-31 23:36:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-03-31 23:36:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:37:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:37:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:37:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:37:23 [DEBUG   ] Finished updating board flags in 1.412 seconds
2021-03-31 23:37:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-03-31 23:37:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-03-31 23:38:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 23:38:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:38:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:38:23 [DEBUG   ] Finished updating board flags in 1.403 seconds
2021-03-31 23:38:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-03-31 23:38:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 23:39:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-03-31 23:39:20 [DEBUG   ] Got command RPT from MCS: ref #9314
2021-03-31 23:39:20 [DEBUG   ] summary = ERROR
2021-03-31 23:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9314  13 59304 85160361 A  ERRORERROR'
2021-03-31 23:39:20 [DEBUG   ] Got command RPT from MCS: ref #9315
2021-03-31 23:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9315  77 59304 85160361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:39:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:39:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:39:23 [DEBUG   ] Finished updating board flags in 1.391 seconds
2021-03-31 23:39:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:39:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 23:39:47 [DEBUG   ] Got command RPT from MCS: ref #9336
2021-03-31 23:39:47 [DEBUG   ] summary = ERROR
2021-03-31 23:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9336  13 59304 85187477 A  ERRORERROR'
2021-03-31 23:39:47 [DEBUG   ] Got command RPT from MCS: ref #9338
2021-03-31 23:39:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9338  77 59304 85187681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:39:47 [DEBUG   ] Got command RPT from MCS: ref #9340
2021-03-31 23:39:47 [DEBUG   ] summary = ERROR
2021-03-31 23:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9340  13 59304 85187873 A  ERRORERROR'
2021-03-31 23:39:48 [DEBUG   ] Got command RPT from MCS: ref #9342
2021-03-31 23:39:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:39:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9342  77 59304 85188077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:39:48 [DEBUG   ] Got command RPT from MCS: ref #9344
2021-03-31 23:39:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:39:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9344  12 59304 85188281 A  ERRORB–™š'
2021-03-31 23:40:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 23:40:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:40:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:40:23 [DEBUG   ] Finished updating board flags in 1.373 seconds
2021-03-31 23:40:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:40:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:41:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 23:41:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:41:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:41:24 [DEBUG   ] Finished updating board flags in 2.064 seconds
2021-03-31 23:41:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:41:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:42:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:42:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:42:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:42:24 [DEBUG   ] Finished updating board flags in 2.019 seconds
2021-03-31 23:42:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 23:42:46 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-03-31 23:43:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:43:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:43:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:43:24 [DEBUG   ] Finished updating board flags in 2.021 seconds
2021-03-31 23:43:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:43:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 23:44:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:44:20 [DEBUG   ] Got command RPT from MCS: ref #9355
2021-03-31 23:44:20 [DEBUG   ] summary = ERROR
2021-03-31 23:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9355  13 59304 85460361 A  ERRORERROR'
2021-03-31 23:44:20 [DEBUG   ] Got command RPT from MCS: ref #9356
2021-03-31 23:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9356  77 59304 85460361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:44:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:44:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:44:24 [DEBUG   ] Finished updating board flags in 2.034 seconds
2021-03-31 23:44:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:44:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-03-31 23:44:47 [DEBUG   ] Got command RPT from MCS: ref #9372
2021-03-31 23:44:47 [DEBUG   ] summary = ERROR
2021-03-31 23:44:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9372  13 59304 85487549 A  ERRORERROR'
2021-03-31 23:44:47 [DEBUG   ] Got command RPT from MCS: ref #9373
2021-03-31 23:44:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:44:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9373  77 59304 85487753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:44:47 [DEBUG   ] Got command RPT from MCS: ref #9374
2021-03-31 23:44:47 [DEBUG   ] summary = ERROR
2021-03-31 23:44:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9374  13 59304 85487945 A  ERRORERROR'
2021-03-31 23:44:48 [DEBUG   ] Got command RPT from MCS: ref #9375
2021-03-31 23:44:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:44:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9375  77 59304 85488149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:44:48 [DEBUG   ] Got command RPT from MCS: ref #9376
2021-03-31 23:44:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:44:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9376  12 59304 85488353 A  ERRORB–™š'
2021-03-31 23:45:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-03-31 23:45:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:45:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:45:24 [DEBUG   ] Finished updating board flags in 1.899 seconds
2021-03-31 23:45:26 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-03-31 23:45:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 23:46:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 23:46:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:46:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:46:24 [DEBUG   ] Finished updating board flags in 1.827 seconds
2021-03-31 23:46:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-03-31 23:46:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-03-31 23:47:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-03-31 23:47:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:47:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:47:24 [DEBUG   ] Finished updating board flags in 1.780 seconds
2021-03-31 23:47:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-03-31 23:47:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-03-31 23:48:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:48:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:48:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:48:24 [DEBUG   ] Finished updating board flags in 1.629 seconds
2021-03-31 23:48:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:48:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:49:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:49:20 [DEBUG   ] Got command RPT from MCS: ref #9389
2021-03-31 23:49:20 [DEBUG   ] summary = ERROR
2021-03-31 23:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9389  13 59304 85760373 A  ERRORERROR'
2021-03-31 23:49:20 [DEBUG   ] Got command RPT from MCS: ref #9390
2021-03-31 23:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9390  77 59304 85760373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:49:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:49:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:49:24 [DEBUG   ] Finished updating board flags in 1.579 seconds
2021-03-31 23:49:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:49:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:49:47 [DEBUG   ] Got command RPT from MCS: ref #9408
2021-03-31 23:49:47 [DEBUG   ] summary = ERROR
2021-03-31 23:49:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9408  13 59304 85787625 A  ERRORERROR'
2021-03-31 23:49:47 [DEBUG   ] Got command RPT from MCS: ref #9409
2021-03-31 23:49:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:49:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9409  77 59304 85787817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:49:48 [DEBUG   ] Got command RPT from MCS: ref #9410
2021-03-31 23:49:48 [DEBUG   ] summary = ERROR
2021-03-31 23:49:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9410  13 59304 85788021 A  ERRORERROR'
2021-03-31 23:49:48 [DEBUG   ] Got command RPT from MCS: ref #9411
2021-03-31 23:49:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:49:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9411  77 59304 85788225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:49:48 [DEBUG   ] Got command RPT from MCS: ref #9413
2021-03-31 23:49:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:49:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9413  12 59304 85788417 A  ERRORB–™š'
2021-03-31 23:50:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:50:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:50:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:50:24 [DEBUG   ] Finished updating board flags in 1.437 seconds
2021-03-31 23:50:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 23:50:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 23:51:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:51:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:51:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:51:24 [DEBUG   ] Finished updating board flags in 1.559 seconds
2021-03-31 23:51:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 23:51:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:52:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-03-31 23:52:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:52:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:52:25 [DEBUG   ] Finished updating board flags in 1.586 seconds
2021-03-31 23:52:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:52:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-03-31 23:53:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-03-31 23:53:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:53:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:53:25 [DEBUG   ] Finished updating board flags in 2.177 seconds
2021-03-31 23:53:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-03-31 23:53:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-03-31 23:54:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-03-31 23:54:20 [DEBUG   ] Got command RPT from MCS: ref #9424
2021-03-31 23:54:20 [DEBUG   ] summary = ERROR
2021-03-31 23:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9424  13 59304 86060369 A  ERRORERROR'
2021-03-31 23:54:20 [DEBUG   ] Got command RPT from MCS: ref #9425
2021-03-31 23:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9425  77 59304 86060369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:54:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:54:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:54:25 [DEBUG   ] Finished updating board flags in 1.866 seconds
2021-03-31 23:54:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-03-31 23:54:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 23:54:47 [DEBUG   ] Got command RPT from MCS: ref #9444
2021-03-31 23:54:47 [DEBUG   ] summary = ERROR
2021-03-31 23:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9444  13 59304 86087697 A  ERRORERROR'
2021-03-31 23:54:47 [DEBUG   ] Got command RPT from MCS: ref #9446
2021-03-31 23:54:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9446  77 59304 86087889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:54:48 [DEBUG   ] Got command RPT from MCS: ref #9448
2021-03-31 23:54:48 [DEBUG   ] summary = ERROR
2021-03-31 23:54:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9448  13 59304 86088093 A  ERRORERROR'
2021-03-31 23:54:48 [DEBUG   ] Got command RPT from MCS: ref #9450
2021-03-31 23:54:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:54:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9450  77 59304 86088297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:54:48 [DEBUG   ] Got command RPT from MCS: ref #9451
2021-03-31 23:54:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:54:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9451  12 59304 86088489 A  ERRORB–™š'
2021-03-31 23:55:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:55:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:55:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:55:25 [DEBUG   ] Finished updating board flags in 1.795 seconds
2021-03-31 23:55:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:55:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 23:56:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:56:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:56:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:56:25 [DEBUG   ] Finished updating board flags in 1.615 seconds
2021-03-31 23:56:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 23:56:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-03-31 23:57:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:57:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:57:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:57:25 [DEBUG   ] Finished updating board flags in 1.579 seconds
2021-03-31 23:57:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 23:57:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-03-31 23:58:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:58:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:58:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:58:25 [DEBUG   ] Finished updating board flags in 1.427 seconds
2021-03-31 23:58:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-03-31 23:58:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-03-31 23:59:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-03-31 23:59:20 [DEBUG   ] Got command RPT from MCS: ref #9458
2021-03-31 23:59:20 [DEBUG   ] summary = ERROR
2021-03-31 23:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9458  13 59304 86360373 A  ERRORERROR'
2021-03-31 23:59:20 [DEBUG   ] Got command RPT from MCS: ref #9459
2021-03-31 23:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9459  77 59304 86360373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:59:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-03-31 23:59:25 [CRITICAL] MGT underflow detected on beam(s) 1
2021-03-31 23:59:25 [DEBUG   ] Finished updating board flags in 1.377 seconds
2021-03-31 23:59:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-03-31 23:59:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-03-31 23:59:47 [DEBUG   ] Got command RPT from MCS: ref #9477
2021-03-31 23:59:47 [DEBUG   ] summary = ERROR
2021-03-31 23:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9477  13 59304 86387765 A  ERRORERROR'
2021-03-31 23:59:47 [DEBUG   ] Got command RPT from MCS: ref #9478
2021-03-31 23:59:47 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9478  77 59304 86387969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:59:48 [DEBUG   ] Got command RPT from MCS: ref #9479
2021-03-31 23:59:48 [DEBUG   ] summary = ERROR
2021-03-31 23:59:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9479  13 59304 86388161 A  ERRORERROR'
2021-03-31 23:59:48 [DEBUG   ] Got command RPT from MCS: ref #9480
2021-03-31 23:59:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-03-31 23:59:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9480  77 59304 86388365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-03-31 23:59:48 [DEBUG   ] Got command RPT from MCS: ref #9482
2021-03-31 23:59:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-03-31 23:59:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9482  12 59304 86388569 A  ERRORB–™š'
2021-04-01 00:00:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 00:00:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:00:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:00:26 [DEBUG   ] Finished updating board flags in 1.565 seconds
2021-04-01 00:00:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 00:00:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:01:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 00:01:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:01:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:01:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:01:27 [DEBUG   ] Finished updating board flags in 2.849 seconds
2021-04-01 00:01:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 00:02:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:02:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:02:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:02:26 [DEBUG   ] Finished updating board flags in 2.057 seconds
2021-04-01 00:02:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-04-01 00:02:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:03:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 00:03:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:03:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:03:26 [DEBUG   ] Finished updating board flags in 1.976 seconds
2021-04-01 00:03:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 00:03:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 00:04:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 00:04:20 [DEBUG   ] Got command RPT from MCS: ref #9499
2021-04-01 00:04:20 [DEBUG   ] summary = ERROR
2021-04-01 00:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9499  13 59305   260365 A  ERRORERROR'
2021-04-01 00:04:20 [DEBUG   ] Got command RPT from MCS: ref #9500
2021-04-01 00:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9500  77 59305   260365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:04:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:04:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:04:26 [DEBUG   ] Finished updating board flags in 1.765 seconds
2021-04-01 00:04:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 00:04:47 [DEBUG   ] Got command RPT from MCS: ref #9516
2021-04-01 00:04:47 [DEBUG   ] summary = ERROR
2021-04-01 00:04:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9516  13 59305   287837 A  ERRORERROR'
2021-04-01 00:04:48 [DEBUG   ] Got command RPT from MCS: ref #9517
2021-04-01 00:04:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:04:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9517  77 59305   288041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:04:48 [DEBUG   ] Got command RPT from MCS: ref #9518
2021-04-01 00:04:48 [DEBUG   ] summary = ERROR
2021-04-01 00:04:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9518  13 59305   288233 A  ERRORERROR'
2021-04-01 00:04:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 00:04:48 [DEBUG   ] Got command RPT from MCS: ref #9519
2021-04-01 00:04:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:04:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9519  77 59305   288437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:04:48 [DEBUG   ] Got command RPT from MCS: ref #9520
2021-04-01 00:04:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:04:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9520  12 59305   288641 A  ERRORB—™š'
2021-04-01 00:05:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:05:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:05:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:05:26 [DEBUG   ] Finished updating board flags in 1.618 seconds
2021-04-01 00:05:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:05:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 00:06:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:06:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:06:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:06:26 [DEBUG   ] Finished updating board flags in 1.566 seconds
2021-04-01 00:06:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:06:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:07:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:07:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:07:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:07:26 [DEBUG   ] Finished updating board flags in 1.419 seconds
2021-04-01 00:07:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:07:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:08:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:08:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:08:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:08:26 [DEBUG   ] Finished updating board flags in 1.421 seconds
2021-04-01 00:08:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:08:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:09:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:09:20 [DEBUG   ] Got command RPT from MCS: ref #9527
2021-04-01 00:09:20 [DEBUG   ] summary = ERROR
2021-04-01 00:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9527  13 59305   560373 A  ERRORERROR'
2021-04-01 00:09:20 [DEBUG   ] Got command RPT from MCS: ref #9528
2021-04-01 00:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9528  77 59305   560373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:09:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:09:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:09:26 [DEBUG   ] Finished updating board flags in 1.422 seconds
2021-04-01 00:09:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:09:47 [DEBUG   ] Got command RPT from MCS: ref #9548
2021-04-01 00:09:47 [DEBUG   ] summary = ERROR
2021-04-01 00:09:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9548  13 59305   587905 A  ERRORERROR'
2021-04-01 00:09:48 [DEBUG   ] Got command RPT from MCS: ref #9550
2021-04-01 00:09:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:09:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9550  77 59305   588109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:09:48 [DEBUG   ] Got command RPT from MCS: ref #9552
2021-04-01 00:09:48 [DEBUG   ] summary = ERROR
2021-04-01 00:09:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9552  13 59305   588313 A  ERRORERROR'
2021-04-01 00:09:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:09:48 [DEBUG   ] Got command RPT from MCS: ref #9554
2021-04-01 00:09:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:09:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9554  77 59305   588505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:09:48 [DEBUG   ] Got command RPT from MCS: ref #9557
2021-04-01 00:09:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:09:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9557  12 59305   588709 A  ERRORB–™š'
2021-04-01 00:10:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:10:26 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:10:26 [DEBUG   ] Finished updating board flags in 1.578 seconds
2021-04-01 00:10:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:10:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:11:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:11:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:11:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:11:27 [DEBUG   ] Finished updating board flags in 2.297 seconds
2021-04-01 00:11:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:11:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 00:12:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 00:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:12:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:12:27 [DEBUG   ] Finished updating board flags in 2.159 seconds
2021-04-01 00:12:28 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-04-01 00:12:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:13:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:13:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:13:27 [DEBUG   ] Finished updating board flags in 2.023 seconds
2021-04-01 00:13:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:13:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:14:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:14:20 [DEBUG   ] Got command RPT from MCS: ref #9568
2021-04-01 00:14:20 [DEBUG   ] summary = ERROR
2021-04-01 00:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9568  13 59305   860373 A  ERRORERROR'
2021-04-01 00:14:20 [DEBUG   ] Got command RPT from MCS: ref #9569
2021-04-01 00:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9569  77 59305   860373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:14:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:14:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:14:27 [DEBUG   ] Finished updating board flags in 1.937 seconds
2021-04-01 00:14:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 00:14:47 [DEBUG   ] Got command RPT from MCS: ref #9585
2021-04-01 00:14:47 [DEBUG   ] summary = ERROR
2021-04-01 00:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9585  13 59305   887985 A  ERRORERROR'
2021-04-01 00:14:48 [DEBUG   ] Got command RPT from MCS: ref #9586
2021-04-01 00:14:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9586  77 59305   888177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:14:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 00:14:48 [DEBUG   ] Got command RPT from MCS: ref #9587
2021-04-01 00:14:48 [DEBUG   ] summary = ERROR
2021-04-01 00:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9587  13 59305   888381 A  ERRORERROR'
2021-04-01 00:14:48 [DEBUG   ] Got command RPT from MCS: ref #9588
2021-04-01 00:14:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9588  77 59305   888585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:14:48 [DEBUG   ] Got command RPT from MCS: ref #9589
2021-04-01 00:14:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9589  12 59305   888789 A  ERRORB–™š'
2021-04-01 00:15:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 00:15:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:15:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:15:27 [DEBUG   ] Finished updating board flags in 1.803 seconds
2021-04-01 00:15:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:15:48 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2021-04-01 00:16:09 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 00:16:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:16:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:16:27 [DEBUG   ] Finished updating board flags in 1.784 seconds
2021-04-01 00:16:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 00:16:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:17:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 00:17:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:17:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:17:27 [DEBUG   ] Finished updating board flags in 1.617 seconds
2021-04-01 00:17:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:17:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:18:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:18:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:18:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:18:27 [DEBUG   ] Finished updating board flags in 1.591 seconds
2021-04-01 00:18:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:18:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 00:19:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:19:20 [DEBUG   ] Got command RPT from MCS: ref #9602
2021-04-01 00:19:20 [DEBUG   ] summary = ERROR
2021-04-01 00:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9602  13 59305  1160377 A  ERRORERROR'
2021-04-01 00:19:20 [DEBUG   ] Got command RPT from MCS: ref #9603
2021-04-01 00:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9603  77 59305  1160377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:19:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:19:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:19:27 [DEBUG   ] Finished updating board flags in 1.450 seconds
2021-04-01 00:19:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 00:19:48 [DEBUG   ] Got command RPT from MCS: ref #9621
2021-04-01 00:19:48 [DEBUG   ] summary = ERROR
2021-04-01 00:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9621  13 59305  1188053 A  ERRORERROR'
2021-04-01 00:19:48 [DEBUG   ] Got command RPT from MCS: ref #9622
2021-04-01 00:19:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9622  77 59305  1188257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:19:48 [DEBUG   ] Got command RPT from MCS: ref #9623
2021-04-01 00:19:48 [DEBUG   ] summary = ERROR
2021-04-01 00:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9623  13 59305  1188449 A  ERRORERROR'
2021-04-01 00:19:48 [DEBUG   ] Got command RPT from MCS: ref #9624
2021-04-01 00:19:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9624  77 59305  1188653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:19:48 [DEBUG   ] Got command RPT from MCS: ref #9626
2021-04-01 00:19:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9626  12 59305  1188857 A  ERRORB–™š'
2021-04-01 00:19:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:20:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 00:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:20:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:20:27 [DEBUG   ] Finished updating board flags in 1.538 seconds
2021-04-01 00:20:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:20:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 00:21:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:21:28 [DEBUG   ] Finished updating board flags in 1.609 seconds
2021-04-01 00:21:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-04-01 00:21:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 00:22:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:22:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:22:27 [DEBUG   ] Finished updating board flags in 1.400 seconds
2021-04-01 00:22:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 00:22:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 00:23:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:23:27 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:23:27 [DEBUG   ] Finished updating board flags in 1.341 seconds
2021-04-01 00:23:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:23:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 00:24:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 00:24:20 [DEBUG   ] Got command RPT from MCS: ref #9637
2021-04-01 00:24:20 [DEBUG   ] summary = ERROR
2021-04-01 00:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9637  13 59305  1460377 A  ERRORERROR'
2021-04-01 00:24:20 [DEBUG   ] Got command RPT from MCS: ref #9638
2021-04-01 00:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9638  77 59305  1460377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:24:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:24:28 [DEBUG   ] Finished updating board flags in 2.075 seconds
2021-04-01 00:24:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:24:48 [DEBUG   ] Got command RPT from MCS: ref #9656
2021-04-01 00:24:48 [DEBUG   ] summary = ERROR
2021-04-01 00:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9656  13 59305  1488121 A  ERRORERROR'
2021-04-01 00:24:48 [DEBUG   ] Got command RPT from MCS: ref #9658
2021-04-01 00:24:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9658  77 59305  1488325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:24:48 [DEBUG   ] Got command RPT from MCS: ref #9660
2021-04-01 00:24:48 [DEBUG   ] summary = ERROR
2021-04-01 00:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9660  13 59305  1488529 A  ERRORERROR'
2021-04-01 00:24:48 [DEBUG   ] Got command RPT from MCS: ref #9662
2021-04-01 00:24:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9662  77 59305  1488723 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:24:48 [DEBUG   ] Got command RPT from MCS: ref #9664
2021-04-01 00:24:48 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9664  12 59305  1488945 A  ERRORB–™š'
2021-04-01 00:24:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 00:25:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 00:25:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:25:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:25:28 [DEBUG   ] Finished updating board flags in 2.020 seconds
2021-04-01 00:25:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 00:25:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 00:26:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2021-04-01 00:26:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:26:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:26:28 [DEBUG   ] Finished updating board flags in 1.991 seconds
2021-04-01 00:26:30 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-04-01 00:26:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:27:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:27:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:27:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:27:28 [DEBUG   ] Finished updating board flags in 1.789 seconds
2021-04-01 00:27:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 00:27:50 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-04-01 00:28:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:28:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:28:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:28:28 [DEBUG   ] Finished updating board flags in 1.604 seconds
2021-04-01 00:28:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:28:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 00:29:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:29:20 [DEBUG   ] Got command RPT from MCS: ref #9671
2021-04-01 00:29:20 [DEBUG   ] summary = ERROR
2021-04-01 00:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9671  13 59305  1760381 A  ERRORERROR'
2021-04-01 00:29:20 [DEBUG   ] Got command RPT from MCS: ref #9672
2021-04-01 00:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9672  77 59305  1760381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:29:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:29:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:29:28 [DEBUG   ] Finished updating board flags in 1.609 seconds
2021-04-01 00:29:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:29:48 [DEBUG   ] Got command RPT from MCS: ref #9690
2021-04-01 00:29:48 [DEBUG   ] summary = ERROR
2021-04-01 00:29:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9690  13 59305  1788201 A  ERRORERROR'
2021-04-01 00:29:48 [DEBUG   ] Got command RPT from MCS: ref #9691
2021-04-01 00:29:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:29:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9691  77 59305  1788405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:29:48 [DEBUG   ] Got command RPT from MCS: ref #9692
2021-04-01 00:29:48 [DEBUG   ] summary = ERROR
2021-04-01 00:29:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9692  13 59305  1788597 A  ERRORERROR'
2021-04-01 00:29:48 [DEBUG   ] Got command RPT from MCS: ref #9693
2021-04-01 00:29:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:29:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9693  77 59305  1788801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:29:49 [DEBUG   ] Got command RPT from MCS: ref #9695
2021-04-01 00:29:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9695  12 59305  1789005 A  ERRORB–™š'
2021-04-01 00:29:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:30:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 00:30:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:30:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:30:28 [DEBUG   ] Finished updating board flags in 1.592 seconds
2021-04-01 00:30:30 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2021-04-01 00:30:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:31:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 00:31:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:31:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:31:28 [DEBUG   ] Finished updating board flags in 1.413 seconds
2021-04-01 00:31:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-04-01 00:31:50 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2021-04-01 00:32:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:32:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:32:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:32:28 [DEBUG   ] Finished updating board flags in 1.381 seconds
2021-04-01 00:32:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 00:32:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:33:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:33:28 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:33:28 [DEBUG   ] Finished updating board flags in 1.382 seconds
2021-04-01 00:33:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 00:33:51 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 00:34:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:34:20 [DEBUG   ] Got command RPT from MCS: ref #9712
2021-04-01 00:34:20 [DEBUG   ] summary = ERROR
2021-04-01 00:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9712  13 59305  2060381 A  ERRORERROR'
2021-04-01 00:34:20 [DEBUG   ] Got command RPT from MCS: ref #9713
2021-04-01 00:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9713  77 59305  2060381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:34:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:34:29 [DEBUG   ] Finished updating board flags in 2.027 seconds
2021-04-01 00:34:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:34:48 [DEBUG   ] Got command RPT from MCS: ref #9729
2021-04-01 00:34:48 [DEBUG   ] summary = ERROR
2021-04-01 00:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9729  13 59305  2088277 A  ERRORERROR'
2021-04-01 00:34:48 [DEBUG   ] Got command RPT from MCS: ref #9730
2021-04-01 00:34:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9730  77 59305  2088469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:34:48 [DEBUG   ] Got command RPT from MCS: ref #9731
2021-04-01 00:34:48 [DEBUG   ] summary = ERROR
2021-04-01 00:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9731  13 59305  2088673 A  ERRORERROR'
2021-04-01 00:34:48 [DEBUG   ] Got command RPT from MCS: ref #9732
2021-04-01 00:34:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9732  77 59305  2088877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:34:49 [DEBUG   ] Got command RPT from MCS: ref #9733
2021-04-01 00:34:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9733  12 59305  2089081 A  ERRORB–™š'
2021-04-01 00:34:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 00:35:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 00:35:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:35:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:35:29 [DEBUG   ] Finished updating board flags in 2.019 seconds
2021-04-01 00:35:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 00:35:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:36:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 00:36:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:36:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:36:29 [DEBUG   ] Finished updating board flags in 1.978 seconds
2021-04-01 00:36:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 00:36:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 00:37:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:37:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:37:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:37:29 [DEBUG   ] Finished updating board flags in 1.887 seconds
2021-04-01 00:37:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-04-01 00:37:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 00:38:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 00:38:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:38:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:38:29 [DEBUG   ] Finished updating board flags in 1.722 seconds
2021-04-01 00:38:32 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-04-01 00:38:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-04-01 00:39:11 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-04-01 00:39:20 [DEBUG   ] Got command RPT from MCS: ref #9740
2021-04-01 00:39:20 [DEBUG   ] summary = ERROR
2021-04-01 00:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9740  13 59305  2360385 A  ERRORERROR'
2021-04-01 00:39:20 [DEBUG   ] Got command RPT from MCS: ref #9741
2021-04-01 00:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9741  77 59305  2360385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:39:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:39:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:39:29 [DEBUG   ] Finished updating board flags in 1.643 seconds
2021-04-01 00:39:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:39:48 [DEBUG   ] Got command RPT from MCS: ref #9761
2021-04-01 00:39:48 [DEBUG   ] summary = ERROR
2021-04-01 00:39:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9761  13 59305  2388341 A  ERRORERROR'
2021-04-01 00:39:48 [DEBUG   ] Got command RPT from MCS: ref #9763
2021-04-01 00:39:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:39:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9763  77 59305  2388545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:39:48 [DEBUG   ] Got command RPT from MCS: ref #9765
2021-04-01 00:39:48 [DEBUG   ] summary = ERROR
2021-04-01 00:39:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9765  13 59305  2388749 A  ERRORERROR'
2021-04-01 00:39:48 [DEBUG   ] Got command RPT from MCS: ref #9767
2021-04-01 00:39:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:39:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9767  77 59305  2388941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:39:49 [DEBUG   ] Got command RPT from MCS: ref #9770
2021-04-01 00:39:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:39:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9770  12 59305  2389145 A  ERRORB–™š'
2021-04-01 00:39:53 [DEBUG   ] Finished updating ant stats in 2.202 seconds
2021-04-01 00:40:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 00:40:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:40:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:40:29 [DEBUG   ] Finished updating board flags in 1.562 seconds
2021-04-01 00:40:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:40:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:41:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:41:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:41:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:41:29 [DEBUG   ] Finished updating board flags in 1.427 seconds
2021-04-01 00:41:32 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-04-01 00:41:52 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 00:42:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:42:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:42:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:42:29 [DEBUG   ] Finished updating board flags in 1.383 seconds
2021-04-01 00:42:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-04-01 00:42:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 00:43:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:43:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 00:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:43:29 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:43:29 [DEBUG   ] Finished updating board flags in 1.383 seconds
2021-04-01 00:43:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 00:43:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 00:44:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 00:44:20 [DEBUG   ] Got command RPT from MCS: ref #9781
2021-04-01 00:44:20 [DEBUG   ] summary = ERROR
2021-04-01 00:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9781  13 59305  2660377 A  ERRORERROR'
2021-04-01 00:44:20 [DEBUG   ] Got command RPT from MCS: ref #9782
2021-04-01 00:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9782  77 59305  2660377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:44:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:44:30 [DEBUG   ] Finished updating board flags in 2.039 seconds
2021-04-01 00:44:33 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 00:44:48 [DEBUG   ] Got command RPT from MCS: ref #9798
2021-04-01 00:44:48 [DEBUG   ] summary = ERROR
2021-04-01 00:44:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9798  13 59305  2688413 A  ERRORERROR'
2021-04-01 00:44:48 [DEBUG   ] Got command RPT from MCS: ref #9799
2021-04-01 00:44:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:44:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9799  77 59305  2688617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:44:48 [DEBUG   ] Got command RPT from MCS: ref #9800
2021-04-01 00:44:48 [DEBUG   ] summary = ERROR
2021-04-01 00:44:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9800  13 59305  2688821 A  ERRORERROR'
2021-04-01 00:44:49 [DEBUG   ] Got command RPT from MCS: ref #9801
2021-04-01 00:44:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:44:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9801  77 59305  2689013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:44:49 [DEBUG   ] Got command RPT from MCS: ref #9802
2021-04-01 00:44:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:44:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9802  12 59305  2689217 A  ERRORB˜™š'
2021-04-01 00:44:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-04-01 00:45:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:45:30 [DEBUG   ] Finished updating board flags in 2.009 seconds
2021-04-01 00:45:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:45:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 00:46:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:46:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:46:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:46:30 [DEBUG   ] Finished updating board flags in 1.971 seconds
2021-04-01 00:46:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 00:46:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:47:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 00:47:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:47:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:47:30 [DEBUG   ] Finished updating board flags in 1.841 seconds
2021-04-01 00:47:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:47:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 00:48:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:48:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:48:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:48:30 [DEBUG   ] Finished updating board flags in 1.807 seconds
2021-04-01 00:48:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:48:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:49:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:49:20 [DEBUG   ] Got command RPT from MCS: ref #9815
2021-04-01 00:49:20 [DEBUG   ] summary = ERROR
2021-04-01 00:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9815  13 59305  2960377 A  ERRORERROR'
2021-04-01 00:49:20 [DEBUG   ] Got command RPT from MCS: ref #9816
2021-04-01 00:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9816  77 59305  2960377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:49:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:49:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:49:30 [DEBUG   ] Finished updating board flags in 1.861 seconds
2021-04-01 00:49:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:49:48 [DEBUG   ] Got command RPT from MCS: ref #9834
2021-04-01 00:49:48 [DEBUG   ] summary = ERROR
2021-04-01 00:49:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9834  13 59305  2988485 A  ERRORERROR'
2021-04-01 00:49:48 [DEBUG   ] Got command RPT from MCS: ref #9835
2021-04-01 00:49:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:49:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9835  77 59305  2988689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:49:48 [DEBUG   ] Got command RPT from MCS: ref #9836
2021-04-01 00:49:48 [DEBUG   ] summary = ERROR
2021-04-01 00:49:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9836  13 59305  2988881 A  ERRORERROR'
2021-04-01 00:49:49 [DEBUG   ] Got command RPT from MCS: ref #9837
2021-04-01 00:49:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:49:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9837  77 59305  2989085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:49:49 [DEBUG   ] Got command RPT from MCS: ref #9839
2021-04-01 00:49:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:49:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9839  12 59305  2989289 A  ERRORB˜™š'
2021-04-01 00:49:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:50:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 00:50:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:50:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:50:30 [DEBUG   ] Finished updating board flags in 1.714 seconds
2021-04-01 00:50:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 00:50:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:51:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 00:51:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:51:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:51:30 [DEBUG   ] Finished updating board flags in 1.644 seconds
2021-04-01 00:51:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 00:51:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 00:52:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 00:52:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:52:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:52:30 [DEBUG   ] Finished updating board flags in 1.608 seconds
2021-04-01 00:52:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 00:52:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:53:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 00:53:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:53:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:53:30 [DEBUG   ] Finished updating board flags in 1.547 seconds
2021-04-01 00:53:33 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 00:53:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:54:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 00:54:20 [DEBUG   ] Got command RPT from MCS: ref #9850
2021-04-01 00:54:20 [DEBUG   ] summary = ERROR
2021-04-01 00:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9850  13 59305  3260385 A  ERRORERROR'
2021-04-01 00:54:20 [DEBUG   ] Got command RPT from MCS: ref #9851
2021-04-01 00:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9851  77 59305  3260385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:54:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:54:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:54:30 [DEBUG   ] Finished updating board flags in 1.436 seconds
2021-04-01 00:54:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 00:54:48 [DEBUG   ] Got command RPT from MCS: ref #9869
2021-04-01 00:54:48 [DEBUG   ] summary = ERROR
2021-04-01 00:54:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9869  13 59305  3288561 A  ERRORERROR'
2021-04-01 00:54:48 [DEBUG   ] Got command RPT from MCS: ref #9871
2021-04-01 00:54:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:54:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9871  77 59305  3288753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:54:48 [DEBUG   ] Got command RPT from MCS: ref #9873
2021-04-01 00:54:48 [DEBUG   ] summary = ERROR
2021-04-01 00:54:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9873  13 59305  3288957 A  ERRORERROR'
2021-04-01 00:54:49 [DEBUG   ] Got command RPT from MCS: ref #9875
2021-04-01 00:54:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9875  77 59305  3289161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:54:49 [DEBUG   ] Got command RPT from MCS: ref #9877
2021-04-01 00:54:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9877  12 59305  3289353 A  ERRORB—™š'
2021-04-01 00:54:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 00:55:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:55:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:55:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:55:30 [DEBUG   ] Finished updating board flags in 1.447 seconds
2021-04-01 00:55:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 00:55:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 00:56:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:56:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:56:30 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:56:30 [DEBUG   ] Finished updating board flags in 1.548 seconds
2021-04-01 00:56:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 00:56:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 00:57:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 00:57:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:57:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:57:31 [DEBUG   ] Finished updating board flags in 2.271 seconds
2021-04-01 00:57:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 00:57:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 00:58:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-04-01 00:58:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:58:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:58:31 [DEBUG   ] Finished updating board flags in 2.113 seconds
2021-04-01 00:58:34 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-04-01 00:58:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 00:59:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 00:59:20 [DEBUG   ] Got command RPT from MCS: ref #9884
2021-04-01 00:59:20 [DEBUG   ] summary = ERROR
2021-04-01 00:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9884  13 59305  3560381 A  ERRORERROR'
2021-04-01 00:59:20 [DEBUG   ] Got command RPT from MCS: ref #9885
2021-04-01 00:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9885  77 59305  3560381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:59:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 00:59:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 00:59:31 [DEBUG   ] Finished updating board flags in 2.008 seconds
2021-04-01 00:59:34 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-04-01 00:59:48 [DEBUG   ] Got command RPT from MCS: ref #9903
2021-04-01 00:59:48 [DEBUG   ] summary = ERROR
2021-04-01 00:59:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9903  13 59305  3588625 A  ERRORERROR'
2021-04-01 00:59:48 [DEBUG   ] Got command RPT from MCS: ref #9904
2021-04-01 00:59:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:59:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9904  77 59305  3588829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:59:49 [DEBUG   ] Got command RPT from MCS: ref #9905
2021-04-01 00:59:49 [DEBUG   ] summary = ERROR
2021-04-01 00:59:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9905  13 59305  3589033 A  ERRORERROR'
2021-04-01 00:59:49 [DEBUG   ] Got command RPT from MCS: ref #9906
2021-04-01 00:59:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 00:59:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9906  77 59305  3589225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 00:59:49 [DEBUG   ] Got command RPT from MCS: ref #9908
2021-04-01 00:59:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 00:59:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9908  12 59305  3589429 A  ERRORB—™š'
2021-04-01 00:59:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 01:00:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:00:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:00:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:00:31 [DEBUG   ] Finished updating board flags in 1.987 seconds
2021-04-01 01:00:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 01:00:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 01:01:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:01:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:01:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:01:31 [DEBUG   ] Finished updating board flags in 1.826 seconds
2021-04-01 01:01:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:01:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 01:02:14 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2021-04-01 01:02:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:02:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:02:31 [DEBUG   ] Finished updating board flags in 1.828 seconds
2021-04-01 01:02:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:02:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:03:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 01:03:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:03:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:03:31 [DEBUG   ] Finished updating board flags in 1.758 seconds
2021-04-01 01:03:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 01:03:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2021-04-01 01:04:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 01:04:20 [DEBUG   ] Got command RPT from MCS: ref #9925
2021-04-01 01:04:20 [DEBUG   ] summary = ERROR
2021-04-01 01:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9925  13 59305  3860385 A  ERRORERROR'
2021-04-01 01:04:20 [DEBUG   ] Got command RPT from MCS: ref #9926
2021-04-01 01:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9926  77 59305  3860385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:04:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:04:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:04:31 [DEBUG   ] Finished updating board flags in 1.612 seconds
2021-04-01 01:04:35 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2021-04-01 01:04:48 [DEBUG   ] Got command RPT from MCS: ref #9942
2021-04-01 01:04:48 [DEBUG   ] summary = ERROR
2021-04-01 01:04:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9942  13 59305  3888697 A  ERRORERROR'
2021-04-01 01:04:48 [DEBUG   ] Got command RPT from MCS: ref #9943
2021-04-01 01:04:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:04:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9943  77 59305  3888901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:04:49 [DEBUG   ] Got command RPT from MCS: ref #9944
2021-04-01 01:04:49 [DEBUG   ] summary = ERROR
2021-04-01 01:04:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9944  13 59305  3889105 A  ERRORERROR'
2021-04-01 01:04:49 [DEBUG   ] Got command RPT from MCS: ref #9945
2021-04-01 01:04:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:04:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9945  77 59305  3889297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:04:49 [DEBUG   ] Got command RPT from MCS: ref #9946
2021-04-01 01:04:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:04:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9946  12 59305  3889501 A  ERRORB–™š'
2021-04-01 01:04:55 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2021-04-01 01:05:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 01:05:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:05:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:05:31 [DEBUG   ] Finished updating board flags in 1.585 seconds
2021-04-01 01:05:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:05:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:06:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:06:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:06:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:06:31 [DEBUG   ] Finished updating board flags in 1.427 seconds
2021-04-01 01:06:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 01:06:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:07:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:07:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:07:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:07:31 [DEBUG   ] Finished updating board flags in 1.386 seconds
2021-04-01 01:07:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 01:07:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 01:08:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 01:08:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:08:31 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:08:31 [DEBUG   ] Finished updating board flags in 1.462 seconds
2021-04-01 01:08:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 01:08:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 01:09:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 01:09:20 [DEBUG   ] Got command RPT from MCS: ref #9953
2021-04-01 01:09:20 [DEBUG   ] summary = ERROR
2021-04-01 01:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9953  13 59305  4160385 A  ERRORERROR'
2021-04-01 01:09:20 [DEBUG   ] Got command RPT from MCS: ref #9954
2021-04-01 01:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9954  77 59305  4160385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:09:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:09:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:09:32 [DEBUG   ] Finished updating board flags in 2.173 seconds
2021-04-01 01:09:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:09:48 [DEBUG   ] Got command RPT from MCS: ref #9974
2021-04-01 01:09:48 [DEBUG   ] summary = ERROR
2021-04-01 01:09:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9974  13 59305  4188777 A  ERRORERROR'
2021-04-01 01:09:48 [DEBUG   ] Got command RPT from MCS: ref #9976
2021-04-01 01:09:48 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:09:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9976  77 59305  4188969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:09:49 [DEBUG   ] Got command RPT from MCS: ref #9978
2021-04-01 01:09:49 [DEBUG   ] summary = ERROR
2021-04-01 01:09:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9978  13 59305  4189173 A  ERRORERROR'
2021-04-01 01:09:49 [DEBUG   ] Got command RPT from MCS: ref #9980
2021-04-01 01:09:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:09:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9980  77 59305  4189377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:09:49 [DEBUG   ] Got command RPT from MCS: ref #9983
2021-04-01 01:09:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:09:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9983  12 59305  4189569 A  ERRORB–™š'
2021-04-01 01:09:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:10:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:10:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:10:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:10:32 [DEBUG   ] Finished updating board flags in 1.974 seconds
2021-04-01 01:10:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:10:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:11:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:11:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:11:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:11:32 [DEBUG   ] Finished updating board flags in 1.893 seconds
2021-04-01 01:11:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 01:11:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 01:12:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:12:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:12:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:12:32 [DEBUG   ] Finished updating board flags in 1.821 seconds
2021-04-01 01:12:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 01:12:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:13:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:13:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:13:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:13:32 [DEBUG   ] Finished updating board flags in 1.700 seconds
2021-04-01 01:13:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 01:13:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 01:14:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:14:20 [DEBUG   ] Got command RPT from MCS: ref #9994
2021-04-01 01:14:20 [DEBUG   ] summary = ERROR
2021-04-01 01:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9994  13 59305  4460389 A  ERRORERROR'
2021-04-01 01:14:20 [DEBUG   ] Got command RPT from MCS: ref #9995
2021-04-01 01:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9995  77 59305  4460389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:14:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:14:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:14:32 [DEBUG   ] Finished updating board flags in 1.610 seconds
2021-04-01 01:14:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 01:14:48 [DEBUG   ] Got command RPT from MCS: ref #10011
2021-04-01 01:14:48 [DEBUG   ] summary = ERROR
2021-04-01 01:14:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10011  13 59305  4488841 A  ERRORERROR'
2021-04-01 01:14:49 [DEBUG   ] Got command RPT from MCS: ref #10012
2021-04-01 01:14:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10012  77 59305  4489045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:14:49 [DEBUG   ] Got command RPT from MCS: ref #10013
2021-04-01 01:14:49 [DEBUG   ] summary = ERROR
2021-04-01 01:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10013  13 59305  4489249 A  ERRORERROR'
2021-04-01 01:14:49 [DEBUG   ] Got command RPT from MCS: ref #10014
2021-04-01 01:14:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10014  77 59305  4489441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:14:49 [DEBUG   ] Got command RPT from MCS: ref #10015
2021-04-01 01:14:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10015  12 59305  4489645 A  ERRORB•™š'
2021-04-01 01:14:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 01:15:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 01:15:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:15:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:15:32 [DEBUG   ] Finished updating board flags in 1.675 seconds
2021-04-01 01:15:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-04-01 01:15:56 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 01:16:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 01:16:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:16:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:16:32 [DEBUG   ] Finished updating board flags in 1.509 seconds
2021-04-01 01:16:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 01:16:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 01:17:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 01:17:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:17:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:17:32 [DEBUG   ] Finished updating board flags in 1.432 seconds
2021-04-01 01:17:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:17:56 [DEBUG   ] Finished updating ant stats in 1.062 seconds
2021-04-01 01:18:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 01:18:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:18:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:18:32 [DEBUG   ] Finished updating board flags in 1.436 seconds
2021-04-01 01:18:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 01:18:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 01:19:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 01:19:20 [DEBUG   ] Got command RPT from MCS: ref #10028
2021-04-01 01:19:20 [DEBUG   ] summary = ERROR
2021-04-01 01:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10028  13 59305  4760393 A  ERRORERROR'
2021-04-01 01:19:20 [DEBUG   ] Got command RPT from MCS: ref #10029
2021-04-01 01:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10029  77 59305  4760393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:19:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:19:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-04-01 01:19:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:19:32 [DEBUG   ] Finished updating board flags in 1.483 seconds
2021-04-01 01:19:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 01:19:48 [DEBUG   ] Got command RPT from MCS: ref #10047
2021-04-01 01:19:48 [DEBUG   ] summary = ERROR
2021-04-01 01:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10047  13 59305  4788913 A  ERRORERROR'
2021-04-01 01:19:49 [DEBUG   ] Got command RPT from MCS: ref #10048
2021-04-01 01:19:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:19:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10048  77 59305  4789117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:19:49 [DEBUG   ] Got command RPT from MCS: ref #10049
2021-04-01 01:19:49 [DEBUG   ] summary = ERROR
2021-04-01 01:19:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10049  13 59305  4789321 A  ERRORERROR'
2021-04-01 01:19:49 [DEBUG   ] Got command RPT from MCS: ref #10050
2021-04-01 01:19:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:19:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10050  77 59305  4789513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:19:49 [DEBUG   ] Got command RPT from MCS: ref #10052
2021-04-01 01:19:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:19:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10052  12 59305  4789717 A  ERRORB•™š'
2021-04-01 01:19:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 01:20:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 01:20:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:20:32 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:20:32 [DEBUG   ] Finished updating board flags in 1.448 seconds
2021-04-01 01:20:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 01:20:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 01:21:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 01:21:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:21:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:21:33 [DEBUG   ] Finished updating board flags in 2.267 seconds
2021-04-01 01:21:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:21:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 01:22:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:22:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 01:22:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:22:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:22:33 [DEBUG   ] Finished updating board flags in 2.157 seconds
2021-04-01 01:22:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:22:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:23:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:23:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:23:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:23:33 [DEBUG   ] Finished updating board flags in 2.091 seconds
2021-04-01 01:23:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:23:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:24:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:24:20 [DEBUG   ] Got command RPT from MCS: ref #10063
2021-04-01 01:24:20 [DEBUG   ] summary = ERROR
2021-04-01 01:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10063  13 59305  5060393 A  ERRORERROR'
2021-04-01 01:24:20 [DEBUG   ] Got command RPT from MCS: ref #10064
2021-04-01 01:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10064  77 59305  5060393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:24:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 01:24:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:24:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:24:33 [DEBUG   ] Finished updating board flags in 1.910 seconds
2021-04-01 01:24:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:24:48 [DEBUG   ] Got command RPT from MCS: ref #10082
2021-04-01 01:24:48 [DEBUG   ] summary = ERROR
2021-04-01 01:24:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10082  13 59305  5088985 A  ERRORERROR'
2021-04-01 01:24:49 [DEBUG   ] Got command RPT from MCS: ref #10084
2021-04-01 01:24:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10084  77 59305  5089189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:24:49 [DEBUG   ] Got command RPT from MCS: ref #10086
2021-04-01 01:24:49 [DEBUG   ] summary = ERROR
2021-04-01 01:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10086  13 59305  5089393 A  ERRORERROR'
2021-04-01 01:24:49 [DEBUG   ] Got command RPT from MCS: ref #10088
2021-04-01 01:24:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10088  77 59305  5089585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:24:49 [DEBUG   ] Got command RPT from MCS: ref #10090
2021-04-01 01:24:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10090  12 59305  5089789 A  ERRORB˜™š'
2021-04-01 01:24:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:25:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 01:25:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:25:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:25:33 [DEBUG   ] Finished updating board flags in 1.806 seconds
2021-04-01 01:25:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:25:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:26:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:26:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:26:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:26:33 [DEBUG   ] Finished updating board flags in 1.802 seconds
2021-04-01 01:26:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:26:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 01:27:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 01:27:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:27:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:27:33 [DEBUG   ] Finished updating board flags in 1.815 seconds
2021-04-01 01:27:36 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 01:27:57 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2021-04-01 01:28:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 01:28:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:28:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:28:33 [DEBUG   ] Finished updating board flags in 1.783 seconds
2021-04-01 01:28:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 01:28:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 01:29:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 01:29:20 [DEBUG   ] Got command RPT from MCS: ref #10097
2021-04-01 01:29:20 [DEBUG   ] summary = ERROR
2021-04-01 01:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10097  13 59305  5360389 A  ERRORERROR'
2021-04-01 01:29:20 [DEBUG   ] Got command RPT from MCS: ref #10098
2021-04-01 01:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10098  77 59305  5360389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:29:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:29:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:29:33 [DEBUG   ] Finished updating board flags in 1.625 seconds
2021-04-01 01:29:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 01:29:49 [DEBUG   ] Got command RPT from MCS: ref #10116
2021-04-01 01:29:49 [DEBUG   ] summary = ERROR
2021-04-01 01:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10116  13 59305  5389057 A  ERRORERROR'
2021-04-01 01:29:49 [DEBUG   ] Got command RPT from MCS: ref #10117
2021-04-01 01:29:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10117  77 59305  5389286 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:29:49 [DEBUG   ] Got command RPT from MCS: ref #10118
2021-04-01 01:29:49 [DEBUG   ] summary = ERROR
2021-04-01 01:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10118  13 59305  5389465 A  ERRORERROR'
2021-04-01 01:29:49 [DEBUG   ] Got command RPT from MCS: ref #10119
2021-04-01 01:29:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10119  77 59305  5389669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:29:49 [DEBUG   ] Got command RPT from MCS: ref #10121
2021-04-01 01:29:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10121  12 59305  5389861 A  ERRORB˜™š'
2021-04-01 01:29:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 01:30:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 01:30:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:30:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:30:33 [DEBUG   ] Finished updating board flags in 1.579 seconds
2021-04-01 01:30:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 01:30:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:31:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 01:31:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:31:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:31:33 [DEBUG   ] Finished updating board flags in 1.421 seconds
2021-04-01 01:31:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:31:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 01:32:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:32:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:32:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:32:33 [DEBUG   ] Finished updating board flags in 1.532 seconds
2021-04-01 01:32:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 01:32:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:33:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:33:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:33:33 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:33:33 [DEBUG   ] Finished updating board flags in 1.539 seconds
2021-04-01 01:33:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:33:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 01:34:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 01:34:20 [DEBUG   ] Got command RPT from MCS: ref #10138
2021-04-01 01:34:20 [DEBUG   ] summary = ERROR
2021-04-01 01:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10138  13 59305  5660393 A  ERRORERROR'
2021-04-01 01:34:20 [DEBUG   ] Got command RPT from MCS: ref #10139
2021-04-01 01:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10139  77 59305  5660393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:34:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:34:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:34:34 [DEBUG   ] Finished updating board flags in 2.237 seconds
2021-04-01 01:34:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 01:34:49 [DEBUG   ] Got command RPT from MCS: ref #10155
2021-04-01 01:34:49 [DEBUG   ] summary = ERROR
2021-04-01 01:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10155  13 59305  5689133 A  ERRORERROR'
2021-04-01 01:34:49 [DEBUG   ] Got command RPT from MCS: ref #10156
2021-04-01 01:34:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10156  77 59305  5689337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:34:49 [DEBUG   ] Got command RPT from MCS: ref #10157
2021-04-01 01:34:49 [DEBUG   ] summary = ERROR
2021-04-01 01:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10157  13 59305  5689541 A  ERRORERROR'
2021-04-01 01:34:49 [DEBUG   ] Got command RPT from MCS: ref #10158
2021-04-01 01:34:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10158  77 59305  5689733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:34:49 [DEBUG   ] Got command RPT from MCS: ref #10159
2021-04-01 01:34:49 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:34:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10159  12 59305  5689937 A  ERRORB—™š'
2021-04-01 01:34:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:35:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:35:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:35:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:35:34 [DEBUG   ] Finished updating board flags in 2.084 seconds
2021-04-01 01:35:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:35:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:36:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:36:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:36:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:36:34 [DEBUG   ] Finished updating board flags in 2.025 seconds
2021-04-01 01:36:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:36:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:37:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:37:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:37:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:37:34 [DEBUG   ] Finished updating board flags in 1.931 seconds
2021-04-01 01:37:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:37:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 01:38:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:38:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:38:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:38:34 [DEBUG   ] Finished updating board flags in 1.757 seconds
2021-04-01 01:38:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 01:38:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 01:39:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:39:20 [DEBUG   ] Got command RPT from MCS: ref #10166
2021-04-01 01:39:20 [DEBUG   ] summary = ERROR
2021-04-01 01:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10166  13 59305  5960397 A  ERRORERROR'
2021-04-01 01:39:20 [DEBUG   ] Got command RPT from MCS: ref #10167
2021-04-01 01:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10167  77 59305  5960397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:39:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:39:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:39:34 [DEBUG   ] Finished updating board flags in 1.669 seconds
2021-04-01 01:39:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:39:49 [DEBUG   ] Got command RPT from MCS: ref #10187
2021-04-01 01:39:49 [DEBUG   ] summary = ERROR
2021-04-01 01:39:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10187  13 59305  5989213 A  ERRORERROR'
2021-04-01 01:39:49 [DEBUG   ] Got command RPT from MCS: ref #10189
2021-04-01 01:39:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:39:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10189  77 59305  5989405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:39:49 [DEBUG   ] Got command RPT from MCS: ref #10191
2021-04-01 01:39:49 [DEBUG   ] summary = ERROR
2021-04-01 01:39:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10191  13 59305  5989609 A  ERRORERROR'
2021-04-01 01:39:49 [DEBUG   ] Got command RPT from MCS: ref #10193
2021-04-01 01:39:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:39:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10193  77 59305  5989813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:39:50 [DEBUG   ] Got command RPT from MCS: ref #10196
2021-04-01 01:39:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10196  12 59305  5990017 A  ERRORB–™š'
2021-04-01 01:39:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:40:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:40:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:40:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:40:34 [DEBUG   ] Finished updating board flags in 1.554 seconds
2021-04-01 01:40:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:40:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:41:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 01:41:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:41:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:41:34 [DEBUG   ] Finished updating board flags in 1.510 seconds
2021-04-01 01:41:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:41:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 01:42:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:42:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:42:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-04-01 01:42:34 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:42:34 [DEBUG   ] Finished updating board flags in 1.552 seconds
2021-04-01 01:42:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 01:42:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:43:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:43:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:43:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:43:35 [DEBUG   ] Finished updating board flags in 2.196 seconds
2021-04-01 01:43:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:43:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:44:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:44:20 [DEBUG   ] Got command RPT from MCS: ref #10207
2021-04-01 01:44:20 [DEBUG   ] summary = ERROR
2021-04-01 01:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10207  13 59305  6260389 A  ERRORERROR'
2021-04-01 01:44:20 [DEBUG   ] Got command RPT from MCS: ref #10208
2021-04-01 01:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10208  77 59305  6260389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:44:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:44:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:44:35 [DEBUG   ] Finished updating board flags in 2.054 seconds
2021-04-01 01:44:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:44:49 [DEBUG   ] Got command RPT from MCS: ref #10224
2021-04-01 01:44:49 [DEBUG   ] summary = ERROR
2021-04-01 01:44:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10224  13 59305  6289313 A  ERRORERROR'
2021-04-01 01:44:49 [DEBUG   ] Got command RPT from MCS: ref #10225
2021-04-01 01:44:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:44:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10225  77 59305  6289481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:44:49 [DEBUG   ] Got command RPT from MCS: ref #10226
2021-04-01 01:44:49 [DEBUG   ] summary = ERROR
2021-04-01 01:44:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10226  13 59305  6289685 A  ERRORERROR'
2021-04-01 01:44:49 [DEBUG   ] Got command RPT from MCS: ref #10227
2021-04-01 01:44:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:44:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10227  77 59305  6289889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:44:50 [DEBUG   ] Got command RPT from MCS: ref #10228
2021-04-01 01:44:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10228  12 59305  6290081 A  ERRORB•™š'
2021-04-01 01:44:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:45:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:45:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:45:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:45:35 [DEBUG   ] Finished updating board flags in 1.884 seconds
2021-04-01 01:45:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 01:45:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 01:46:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 01:46:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:46:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:46:35 [DEBUG   ] Finished updating board flags in 1.807 seconds
2021-04-01 01:46:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2021-04-01 01:46:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-04-01 01:47:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 01:47:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:47:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:47:35 [DEBUG   ] Finished updating board flags in 1.799 seconds
2021-04-01 01:47:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:47:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 01:48:18 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 01:48:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:48:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:48:35 [DEBUG   ] Finished updating board flags in 1.590 seconds
2021-04-01 01:48:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 01:48:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 01:49:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 01:49:20 [DEBUG   ] Got command RPT from MCS: ref #10241
2021-04-01 01:49:20 [DEBUG   ] summary = ERROR
2021-04-01 01:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10241  13 59305  6560401 A  ERRORERROR'
2021-04-01 01:49:20 [DEBUG   ] Got command RPT from MCS: ref #10242
2021-04-01 01:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10242  77 59305  6560401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:49:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:49:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:49:35 [DEBUG   ] Finished updating board flags in 1.416 seconds
2021-04-01 01:49:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 01:49:49 [DEBUG   ] Got command RPT from MCS: ref #10260
2021-04-01 01:49:49 [DEBUG   ] summary = ERROR
2021-04-01 01:49:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10260  13 59305  6589361 A  ERRORERROR'
2021-04-01 01:49:49 [DEBUG   ] Got command RPT from MCS: ref #10261
2021-04-01 01:49:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:49:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10261  77 59305  6589553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:49:49 [DEBUG   ] Got command RPT from MCS: ref #10262
2021-04-01 01:49:49 [DEBUG   ] summary = ERROR
2021-04-01 01:49:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10262  13 59305  6589775 A  ERRORERROR'
2021-04-01 01:49:49 [DEBUG   ] Got command RPT from MCS: ref #10263
2021-04-01 01:49:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:49:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10263  77 59305  6589953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:49:50 [DEBUG   ] Got command RPT from MCS: ref #10265
2021-04-01 01:49:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10265  12 59305  6590157 A  ERRORB—™š'
2021-04-01 01:49:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 01:50:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 01:50:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:50:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:50:35 [DEBUG   ] Finished updating board flags in 1.424 seconds
2021-04-01 01:50:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 01:50:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 01:51:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 01:51:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:51:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:51:35 [DEBUG   ] Finished updating board flags in 1.455 seconds
2021-04-01 01:51:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 01:51:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:52:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 01:52:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:52:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:52:35 [DEBUG   ] Finished updating board flags in 1.456 seconds
2021-04-01 01:52:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:52:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:53:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:53:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:53:35 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:53:35 [DEBUG   ] Finished updating board flags in 1.582 seconds
2021-04-01 01:53:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 01:53:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 01:54:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 01:54:20 [DEBUG   ] Got command RPT from MCS: ref #10276
2021-04-01 01:54:20 [DEBUG   ] summary = ERROR
2021-04-01 01:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10276  13 59305  6860401 A  ERRORERROR'
2021-04-01 01:54:20 [DEBUG   ] Got command RPT from MCS: ref #10277
2021-04-01 01:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10277  77 59305  6860401 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:54:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:54:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:54:36 [DEBUG   ] Finished updating board flags in 2.196 seconds
2021-04-01 01:54:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 01:54:49 [DEBUG   ] Got command RPT from MCS: ref #10295
2021-04-01 01:54:49 [DEBUG   ] summary = ERROR
2021-04-01 01:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10295  13 59305  6889429 A  ERRORERROR'
2021-04-01 01:54:49 [DEBUG   ] Got command RPT from MCS: ref #10297
2021-04-01 01:54:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10297  77 59305  6889633 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:54:49 [DEBUG   ] Got command RPT from MCS: ref #10299
2021-04-01 01:54:49 [DEBUG   ] summary = ERROR
2021-04-01 01:54:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10299  13 59305  6889825 A  ERRORERROR'
2021-04-01 01:54:50 [DEBUG   ] Got command RPT from MCS: ref #10301
2021-04-01 01:54:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10301  77 59305  6890029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:54:50 [DEBUG   ] Got command RPT from MCS: ref #10303
2021-04-01 01:54:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10303  12 59305  6890233 A  ERRORB˜™š'
2021-04-01 01:54:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-04-01 01:55:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 01:55:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:55:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:55:36 [DEBUG   ] Finished updating board flags in 1.891 seconds
2021-04-01 01:55:39 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 01:55:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 01:56:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:56:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:56:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:56:36 [DEBUG   ] Finished updating board flags in 1.800 seconds
2021-04-01 01:56:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:56:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 01:57:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:57:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:57:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:57:36 [DEBUG   ] Finished updating board flags in 1.792 seconds
2021-04-01 01:57:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:57:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 01:58:11 [DEBUG   ] Got command TBW from MCS: ref #10311
2021-04-01 01:58:11 [DEBUG   ] tbw = exited with status True, code 0x00
2021-04-01 01:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    10311   8 59305  7091333 A  ERROR'
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2021-04-01 01:58:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2021-04-01 01:58:14 [DEBUG   ] spawn_process: at 2021-04-01 01:58:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2021-04-01 01:58:14 [INFO    ] Finished spawning TBW
2021-04-01 01:58:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:58:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:58:36 [DEBUG   ] Finished updating board flags in 1.435 seconds
2021-04-01 01:59:20 [DEBUG   ] Got command RPT from MCS: ref #10315
2021-04-01 01:59:20 [DEBUG   ] summary = ERROR
2021-04-01 01:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10315  13 59305  7160397 A  ERRORERROR'
2021-04-01 01:59:20 [DEBUG   ] Got command RPT from MCS: ref #10316
2021-04-01 01:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10316  77 59305  7160397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:59:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 01:59:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 01:59:36 [DEBUG   ] Finished updating board flags in 1.541 seconds
2021-04-01 01:59:49 [DEBUG   ] Got command RPT from MCS: ref #10335
2021-04-01 01:59:49 [DEBUG   ] summary = ERROR
2021-04-01 01:59:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10335  13 59305  7189501 A  ERRORERROR'
2021-04-01 01:59:49 [DEBUG   ] Got command RPT from MCS: ref #10336
2021-04-01 01:59:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:59:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10336  77 59305  7189705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:59:49 [DEBUG   ] Got command RPT from MCS: ref #10337
2021-04-01 01:59:49 [DEBUG   ] summary = ERROR
2021-04-01 01:59:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10337  13 59305  7189897 A  ERRORERROR'
2021-04-01 01:59:50 [DEBUG   ] Got command RPT from MCS: ref #10338
2021-04-01 01:59:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 01:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10338  77 59305  7190101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 01:59:50 [DEBUG   ] Got command RPT from MCS: ref #10340
2021-04-01 01:59:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 01:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10340  12 59305  7190305 A  ERRORB–™š'
2021-04-01 02:00:02 [INFO    ] __waitForTBW - TBW finished in 107.968 s
2021-04-01 02:00:03 [DEBUG   ] Finished updating ant stats in 0.458 seconds
2021-04-01 02:00:03 [INFO    ] Started antennas statistics background thread
2021-04-01 02:00:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1617242405']
2021-04-01 02:00:03 [DEBUG   ] spawn_process: at 2021-04-01 02:00:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1617242405']
2021-04-01 02:00:03 [INFO    ] Finished spawning TBN in 0.048 s
2021-04-01 02:00:23 [DEBUG   ] Finished updating ant stats in 0.469 seconds
2021-04-01 02:00:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:00:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:00:36 [DEBUG   ] Finished updating board flags in 1.625 seconds
2021-04-01 02:00:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 02:01:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 02:01:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:01:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:01:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:01:36 [DEBUG   ] Finished updating board flags in 1.628 seconds
2021-04-01 02:01:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 02:02:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:02:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 02:02:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:02:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:02:36 [DEBUG   ] Finished updating board flags in 1.631 seconds
2021-04-01 02:02:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 02:03:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:03:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:03:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:03:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:03:36 [DEBUG   ] Finished updating board flags in 1.632 seconds
2021-04-01 02:03:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 02:04:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 02:04:20 [DEBUG   ] Got command RPT from MCS: ref #10360
2021-04-01 02:04:20 [DEBUG   ] summary = ERROR
2021-04-01 02:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10360  13 59305  7460405 A  ERRORERROR'
2021-04-01 02:04:20 [DEBUG   ] Got command RPT from MCS: ref #10361
2021-04-01 02:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10361  77 59305  7460405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:04:23 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 02:04:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:04:36 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:04:36 [DEBUG   ] Finished updating board flags in 1.636 seconds
2021-04-01 02:04:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:04:49 [DEBUG   ] Got command RPT from MCS: ref #10377
2021-04-01 02:04:49 [DEBUG   ] summary = ERROR
2021-04-01 02:04:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10377  13 59305  7489565 A  ERRORERROR'
2021-04-01 02:04:49 [DEBUG   ] Got command RPT from MCS: ref #10378
2021-04-01 02:04:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:04:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10378  77 59305  7489775 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:04:49 [DEBUG   ] Got command RPT from MCS: ref #10379
2021-04-01 02:04:49 [DEBUG   ] summary = ERROR
2021-04-01 02:04:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10379  13 59305  7489977 A  ERRORERROR'
2021-04-01 02:04:50 [DEBUG   ] Got command RPT from MCS: ref #10380
2021-04-01 02:04:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:04:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10380  77 59305  7490169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:04:50 [DEBUG   ] Got command RPT from MCS: ref #10381
2021-04-01 02:04:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:04:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10381  12 59305  7490373 A  ERRORB–™š'
2021-04-01 02:05:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 02:05:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 02:05:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:05:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:05:37 [DEBUG   ] Finished updating board flags in 1.644 seconds
2021-04-01 02:05:43 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 02:06:03 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 02:06:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 02:06:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:06:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:06:37 [DEBUG   ] Finished updating board flags in 1.788 seconds
2021-04-01 02:06:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:07:03 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 02:07:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 02:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 02:07:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:07:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:07:37 [DEBUG   ] Finished updating board flags in 2.216 seconds
2021-04-01 02:07:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-04-01 02:08:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 02:08:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 02:08:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:08:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:08:37 [DEBUG   ] Finished updating board flags in 2.050 seconds
2021-04-01 02:08:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 02:09:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 02:09:20 [DEBUG   ] Got command RPT from MCS: ref #10388
2021-04-01 02:09:20 [DEBUG   ] summary = ERROR
2021-04-01 02:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10388  13 59305  7760405 A  ERRORERROR'
2021-04-01 02:09:20 [DEBUG   ] Got command RPT from MCS: ref #10389
2021-04-01 02:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10389  77 59305  7760405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:09:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:09:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:09:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:09:37 [DEBUG   ] Finished updating board flags in 2.018 seconds
2021-04-01 02:09:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 02:09:49 [DEBUG   ] Got command RPT from MCS: ref #10409
2021-04-01 02:09:49 [DEBUG   ] summary = ERROR
2021-04-01 02:09:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10409  13 59305  7789649 A  ERRORERROR'
2021-04-01 02:09:49 [DEBUG   ] Got command RPT from MCS: ref #10411
2021-04-01 02:09:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:09:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10411  77 59305  7789841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:09:50 [DEBUG   ] Got command RPT from MCS: ref #10413
2021-04-01 02:09:50 [DEBUG   ] summary = ERROR
2021-04-01 02:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10413  13 59305  7790045 A  ERRORERROR'
2021-04-01 02:09:50 [DEBUG   ] Got command RPT from MCS: ref #10415
2021-04-01 02:09:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10415  77 59305  7790249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:09:50 [DEBUG   ] Got command RPT from MCS: ref #10418
2021-04-01 02:09:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10418  12 59305  7790441 A  ERRORB˜™š'
2021-04-01 02:10:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 02:10:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:10:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:10:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:10:37 [DEBUG   ] Finished updating board flags in 1.984 seconds
2021-04-01 02:10:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:11:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:11:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 02:11:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:11:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:11:37 [DEBUG   ] Finished updating board flags in 1.812 seconds
2021-04-01 02:11:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 02:12:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:12:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:12:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:12:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:12:37 [DEBUG   ] Finished updating board flags in 1.810 seconds
2021-04-01 02:12:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 02:13:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 02:13:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 02:13:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:13:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:13:37 [DEBUG   ] Finished updating board flags in 1.785 seconds
2021-04-01 02:13:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-04-01 02:14:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 02:14:20 [DEBUG   ] Got command RPT from MCS: ref #10429
2021-04-01 02:14:20 [DEBUG   ] summary = ERROR
2021-04-01 02:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10429  13 59305  8060397 A  ERRORERROR'
2021-04-01 02:14:20 [DEBUG   ] Got command RPT from MCS: ref #10430
2021-04-01 02:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10430  77 59305  8060397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:14:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-04-01 02:14:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:14:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:14:37 [DEBUG   ] Finished updating board flags in 1.607 seconds
2021-04-01 02:14:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-04-01 02:14:49 [DEBUG   ] Got command RPT from MCS: ref #10446
2021-04-01 02:14:49 [DEBUG   ] summary = ERROR
2021-04-01 02:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10446  13 59305  8089713 A  ERRORERROR'
2021-04-01 02:14:49 [DEBUG   ] Got command RPT from MCS: ref #10447
2021-04-01 02:14:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10447  77 59305  8089917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:14:50 [DEBUG   ] Got command RPT from MCS: ref #10448
2021-04-01 02:14:50 [DEBUG   ] summary = ERROR
2021-04-01 02:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10448  13 59305  8090121 A  ERRORERROR'
2021-04-01 02:14:50 [DEBUG   ] Got command RPT from MCS: ref #10449
2021-04-01 02:14:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10449  77 59305  8090313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:14:50 [DEBUG   ] Got command RPT from MCS: ref #10450
2021-04-01 02:14:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10450  12 59305  8090517 A  ERRORB—™š'
2021-04-01 02:15:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 02:15:25 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-04-01 02:15:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:15:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:15:37 [DEBUG   ] Finished updating board flags in 1.601 seconds
2021-04-01 02:15:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:16:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:16:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:16:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:16:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:16:37 [DEBUG   ] Finished updating board flags in 1.587 seconds
2021-04-01 02:16:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:17:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:17:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:17:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:17:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:17:37 [DEBUG   ] Finished updating board flags in 1.521 seconds
2021-04-01 02:17:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:18:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:18:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:18:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:18:37 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:18:37 [DEBUG   ] Finished updating board flags in 1.574 seconds
2021-04-01 02:18:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:19:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:19:20 [DEBUG   ] Got command RPT from MCS: ref #10463
2021-04-01 02:19:20 [DEBUG   ] summary = ERROR
2021-04-01 02:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10463  13 59305  8360405 A  ERRORERROR'
2021-04-01 02:19:20 [DEBUG   ] Got command RPT from MCS: ref #10464
2021-04-01 02:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10464  77 59305  8360405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:19:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 02:19:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:19:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-04-01 02:19:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:19:38 [DEBUG   ] Finished updating board flags in 2.241 seconds
2021-04-01 02:19:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:19:49 [DEBUG   ] Got command RPT from MCS: ref #10482
2021-04-01 02:19:49 [DEBUG   ] summary = ERROR
2021-04-01 02:19:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10482  13 59305  8389789 A  ERRORERROR'
2021-04-01 02:19:49 [DEBUG   ] Got command RPT from MCS: ref #10483
2021-04-01 02:19:49 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:19:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10483  77 59305  8389993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:19:50 [DEBUG   ] Got command RPT from MCS: ref #10484
2021-04-01 02:19:50 [DEBUG   ] summary = ERROR
2021-04-01 02:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10484  13 59305  8390185 A  ERRORERROR'
2021-04-01 02:19:50 [DEBUG   ] Got command RPT from MCS: ref #10485
2021-04-01 02:19:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10485  77 59305  8390389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:19:50 [DEBUG   ] Got command RPT from MCS: ref #10487
2021-04-01 02:19:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10487  12 59305  8390593 A  ERRORB–™š'
2021-04-01 02:20:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:20:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:20:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:20:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:20:38 [DEBUG   ] Finished updating board flags in 2.071 seconds
2021-04-01 02:20:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:21:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:21:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:21:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:21:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:21:38 [DEBUG   ] Finished updating board flags in 2.033 seconds
2021-04-01 02:21:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 02:22:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:22:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:22:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:22:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:22:38 [DEBUG   ] Finished updating board flags in 2.007 seconds
2021-04-01 02:22:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:23:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 02:23:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 02:23:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:23:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:23:38 [DEBUG   ] Finished updating board flags in 2.010 seconds
2021-04-01 02:23:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:24:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:24:20 [DEBUG   ] Got command RPT from MCS: ref #10498
2021-04-01 02:24:20 [DEBUG   ] summary = ERROR
2021-04-01 02:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10498  13 59305  8660409 A  ERRORERROR'
2021-04-01 02:24:20 [DEBUG   ] Got command RPT from MCS: ref #10499
2021-04-01 02:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10499  77 59305  8660409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:24:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 02:24:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:24:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:24:38 [DEBUG   ] Finished updating board flags in 2.094 seconds
2021-04-01 02:24:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:24:49 [DEBUG   ] Got command RPT from MCS: ref #10517
2021-04-01 02:24:49 [DEBUG   ] summary = ERROR
2021-04-01 02:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10517  13 59305  8689857 A  ERRORERROR'
2021-04-01 02:24:50 [DEBUG   ] Got command RPT from MCS: ref #10519
2021-04-01 02:24:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10519  77 59305  8690061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:24:50 [DEBUG   ] Got command RPT from MCS: ref #10521
2021-04-01 02:24:50 [DEBUG   ] summary = ERROR
2021-04-01 02:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10521  13 59305  8690265 A  ERRORERROR'
2021-04-01 02:24:50 [DEBUG   ] Got command RPT from MCS: ref #10523
2021-04-01 02:24:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10523  77 59305  8690457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:24:50 [DEBUG   ] Got command RPT from MCS: ref #10525
2021-04-01 02:24:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10525  12 59305  8690661 A  ERRORB˜™š'
2021-04-01 02:25:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:25:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:25:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:25:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:25:38 [DEBUG   ] Finished updating board flags in 1.863 seconds
2021-04-01 02:25:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 02:26:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:26:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:26:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:26:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:26:38 [DEBUG   ] Finished updating board flags in 1.820 seconds
2021-04-01 02:26:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:27:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 02:27:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:27:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:27:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:27:38 [DEBUG   ] Finished updating board flags in 1.788 seconds
2021-04-01 02:27:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:28:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:28:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 02:28:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:28:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:28:38 [DEBUG   ] Finished updating board flags in 1.618 seconds
2021-04-01 02:28:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 02:29:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:29:20 [DEBUG   ] Got command RPT from MCS: ref #10532
2021-04-01 02:29:20 [DEBUG   ] summary = ERROR
2021-04-01 02:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10532  13 59305  8960409 A  ERRORERROR'
2021-04-01 02:29:20 [DEBUG   ] Got command RPT from MCS: ref #10533
2021-04-01 02:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10533  77 59305  8960409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:29:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 02:29:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:29:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:29:38 [DEBUG   ] Finished updating board flags in 1.692 seconds
2021-04-01 02:29:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 02:29:49 [DEBUG   ] Got command RPT from MCS: ref #10551
2021-04-01 02:29:49 [DEBUG   ] summary = ERROR
2021-04-01 02:29:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10551  13 59305  8989933 A  ERRORERROR'
2021-04-01 02:29:50 [DEBUG   ] Got command RPT from MCS: ref #10552
2021-04-01 02:29:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10552  77 59305  8990137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:29:50 [DEBUG   ] Got command RPT from MCS: ref #10553
2021-04-01 02:29:50 [DEBUG   ] summary = ERROR
2021-04-01 02:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10553  13 59305  8990341 A  ERRORERROR'
2021-04-01 02:29:50 [DEBUG   ] Got command RPT from MCS: ref #10554
2021-04-01 02:29:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10554  77 59305  8990533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:29:50 [DEBUG   ] Got command RPT from MCS: ref #10556
2021-04-01 02:29:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10556  12 59305  8990737 A  ERRORB—™š'
2021-04-01 02:30:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 02:30:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:30:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:30:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:30:38 [DEBUG   ] Finished updating board flags in 1.612 seconds
2021-04-01 02:30:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 02:31:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 02:31:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 02:31:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:31:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:31:38 [DEBUG   ] Finished updating board flags in 1.494 seconds
2021-04-01 02:31:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:32:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:32:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 02:32:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:32:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:32:38 [DEBUG   ] Finished updating board flags in 1.479 seconds
2021-04-01 02:32:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 02:33:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:33:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:33:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:33:38 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:33:38 [DEBUG   ] Finished updating board flags in 1.491 seconds
2021-04-01 02:33:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 02:34:01 [DEBUG   ] Got command RPT from MCS: ref #10573
2021-04-01 02:34:01 [DEBUG   ] summary = ERROR
2021-04-01 02:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10573  13 59305  9241005 A  ERRORERROR'
2021-04-01 02:34:01 [DEBUG   ] Got command RPT from MCS: ref #10574
2021-04-01 02:34:01 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10574  77 59305  9241005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:34:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 02:34:06 [DEBUG   ] Got command INI from MCS: ref #10575
2021-04-01 02:34:06 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2021-04-01 02:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    10575   8 59305  9246005 ABOOTING'
2021-04-01 02:34:20 [DEBUG   ] Got command RPT from MCS: ref #10576
2021-04-01 02:34:20 [DEBUG   ] summary = BOOTING
2021-04-01 02:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10576  15 59305  9260401 ABOOTINGBOOTING'
2021-04-01 02:34:20 [DEBUG   ] Got command RPT from MCS: ref #10577
2021-04-01 02:34:20 [DEBUG   ] info = Running INI sequence
2021-04-01 02:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10577  28 59305  9260401 ABOOTINGRunning INI sequence'
2021-04-01 02:34:29 [INFO    ] -------------------
2021-04-01 02:34:29 [INFO    ]  LWA board status
2021-04-01 02:34:29 [INFO    ] -------------------
2021-04-01 02:34:29 [INFO    ] DP 1: 2 lwa27
2021-04-01 02:34:29 [INFO    ] DP 1: 3 lwa24
2021-04-01 02:34:29 [INFO    ] DP 1: 4 lwa23
2021-04-01 02:34:29 [INFO    ] DP 1: 5 lwa18
2021-04-01 02:34:29 [INFO    ] DP 1: 6 lwa10
2021-04-01 02:34:29 [INFO    ] DP 1: 7 lwa32
2021-04-01 02:34:29 [INFO    ] DP 1: 8 lwa11
2021-04-01 02:34:29 [INFO    ] DP 1: 9 lwa30
2021-04-01 02:34:29 [INFO    ] DP 1: 10 lwa12
2021-04-01 02:34:29 [INFO    ] DP 1: 11 lwa8
2021-04-01 02:34:29 [INFO    ] DP 1: 12 lwa13
2021-04-01 02:34:29 [INFO    ] DP 1: 13 lwa26
2021-04-01 02:34:29 [INFO    ] DP 1: 14 lwa14
2021-04-01 02:34:29 [INFO    ] DP 1: 16 lwa22
2021-04-01 02:34:29 [INFO    ] DP 1: 17 lwa20
2021-04-01 02:34:29 [INFO    ] DP 1: 18 lwa1
2021-04-01 02:34:29 [INFO    ] DP 1: 19 lwa5
2021-04-01 02:34:29 [INFO    ] DP 1: 20 lwa25
2021-04-01 02:34:29 [INFO    ] DP 1: 21 lwa35
2021-04-01 02:34:29 [INFO    ] DP 1: 22 lwa19
2021-04-01 02:34:29 [INFO    ] DP 1: 23 lwa21
2021-04-01 02:34:29 [INFO    ] DP 1: 24 lwa6
2021-04-01 02:34:29 [INFO    ] DP 1: 25 lwa7
2021-04-01 02:34:29 [INFO    ] DP 1: 26 lwa33
2021-04-01 02:34:29 [INFO    ] DP 1: 27 lwa15
2021-04-01 02:34:29 [INFO    ] DP 1: 28 lwa28
2021-04-01 02:34:29 [INFO    ] DP 2: 1 lwa16
2021-04-01 02:34:29 [INFO    ] DP 2: 15 lwa34
2021-04-01 02:34:29 [INFO    ] Total of 28 boards
2021-04-01 02:34:29 [INFO    ] Total of 260 stands
2021-04-01 02:34:29 [INFO    ] -------------------
2021-04-01 02:34:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14918
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14919
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14920
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14921
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14922
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14923
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14924
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14925
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14926
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14927
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14928
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14929
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14930
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14931
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14932
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14933
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14934
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14935
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14936
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14937
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14938
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14939
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14940
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14941
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14942
2021-04-01 02:34:36 [DEBUG   ] 2021-04-01 02:34:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14943
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14918 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14919 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14920 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14921 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14922 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14923 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14924 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14925 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14926 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14927 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14928 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14929 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14930 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14931 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14932 exited with status 0
2021-04-01 02:34:48 [DEBUG   ] 2021-04-01 02:34:48 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14933 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14934 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14935 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14936 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14937 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14938 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14939 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14940 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14941 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14942 exited with status 0
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14943 exited with status 0
2021-04-01 02:34:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] spawn_process: at 2021-04-01 02:34:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14970
2021-04-01 02:34:49 [DEBUG   ] 2021-04-01 02:34:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14971
2021-04-01 02:34:50 [DEBUG   ] Got command RPT from MCS: ref #10593
2021-04-01 02:34:50 [DEBUG   ] summary = BOOTING
2021-04-01 02:34:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10593  15 59305  9290005 ABOOTINGBOOTING'
2021-04-01 02:34:54 [DEBUG   ] 2021-04-01 02:34:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14970 exited with status 0
2021-04-01 02:34:54 [DEBUG   ] 2021-04-01 02:34:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14971 exited with status 0
2021-04-01 02:34:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2021-04-01 02:34:54 [DEBUG   ] spawn_process: at 2021-04-01 02:34:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2021-04-01 02:34:54 [DEBUG   ] spawn_process: at 2021-04-01 02:34:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2021-04-01 02:34:54 [INFO    ] Setting Beam 1 xbars
2021-04-01 02:34:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2021-04-01 02:34:55 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2021-04-01 02:34:55 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2021-04-01 02:34:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2021-04-01 02:34:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2021-04-01 02:34:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2021-04-01 02:34:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2021-04-01 02:34:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2021-04-01 02:34:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2021-04-01 02:34:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2021-04-01 02:34:56 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2021-04-01 02:34:56 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2021-04-01 02:34:56 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2021-04-01 02:34:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2021-04-01 02:34:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2021-04-01 02:34:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2021-04-01 02:34:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2021-04-01 02:34:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2021-04-01 02:34:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2021-04-01 02:34:57 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2021-04-01 02:34:57 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2021-04-01 02:34:57 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2021-04-01 02:34:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2021-04-01 02:34:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2021-04-01 02:34:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2021-04-01 02:34:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2021-04-01 02:34:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2021-04-01 02:34:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2021-04-01 02:34:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2021-04-01 02:34:59 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2021-04-01 02:34:59 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2021-04-01 02:34:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2021-04-01 02:34:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2021-04-01 02:34:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2021-04-01 02:34:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2021-04-01 02:34:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2021-04-01 02:34:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2021-04-01 02:34:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2021-04-01 02:35:00 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2021-04-01 02:35:00 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2021-04-01 02:35:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2021-04-01 02:35:00 [INFO    ] Setting Beam 2 xbars
2021-04-01 02:35:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2021-04-01 02:35:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2021-04-01 02:35:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2021-04-01 02:35:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2021-04-01 02:35:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2021-04-01 02:35:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2021-04-01 02:35:01 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2021-04-01 02:35:01 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2021-04-01 02:35:01 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2021-04-01 02:35:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2021-04-01 02:35:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2021-04-01 02:35:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2021-04-01 02:35:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2021-04-01 02:35:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2021-04-01 02:35:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2021-04-01 02:35:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2021-04-01 02:35:03 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2021-04-01 02:35:03 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2021-04-01 02:35:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2021-04-01 02:35:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2021-04-01 02:35:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2021-04-01 02:35:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2021-04-01 02:35:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2021-04-01 02:35:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2021-04-01 02:35:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2021-04-01 02:35:04 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2021-04-01 02:35:04 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2021-04-01 02:35:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2021-04-01 02:35:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2021-04-01 02:35:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2021-04-01 02:35:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2021-04-01 02:35:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2021-04-01 02:35:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2021-04-01 02:35:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2021-04-01 02:35:05 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2021-04-01 02:35:05 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2021-04-01 02:35:05 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2021-04-01 02:35:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2021-04-01 02:35:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2021-04-01 02:35:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2021-04-01 02:35:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2021-04-01 02:35:05 [INFO    ] Setting Beam 3 xbars
2021-04-01 02:35:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2021-04-01 02:35:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2021-04-01 02:35:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2021-04-01 02:35:06 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2021-04-01 02:35:06 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2021-04-01 02:35:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2021-04-01 02:35:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2021-04-01 02:35:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2021-04-01 02:35:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2021-04-01 02:35:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2021-04-01 02:35:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2021-04-01 02:35:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2021-04-01 02:35:07 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2021-04-01 02:35:07 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2021-04-01 02:35:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2021-04-01 02:35:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2021-04-01 02:35:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2021-04-01 02:35:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2021-04-01 02:35:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2021-04-01 02:35:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2021-04-01 02:35:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2021-04-01 02:35:08 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2021-04-01 02:35:08 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2021-04-01 02:35:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2021-04-01 02:35:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2021-04-01 02:35:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2021-04-01 02:35:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2021-04-01 02:35:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2021-04-01 02:35:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2021-04-01 02:35:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2021-04-01 02:35:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2021-04-01 02:35:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2021-04-01 02:35:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2021-04-01 02:35:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2021-04-01 02:35:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2021-04-01 02:35:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2021-04-01 02:35:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2021-04-01 02:35:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2021-04-01 02:35:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2021-04-01 02:35:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2021-04-01 02:35:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2021-04-01 02:35:11 [INFO    ] Setting Beam 4 xbars
2021-04-01 02:35:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2021-04-01 02:35:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2021-04-01 02:35:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2021-04-01 02:35:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2021-04-01 02:35:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2021-04-01 02:35:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2021-04-01 02:35:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2021-04-01 02:35:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2021-04-01 02:35:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2021-04-01 02:35:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2021-04-01 02:35:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2021-04-01 02:35:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2021-04-01 02:35:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2021-04-01 02:35:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2021-04-01 02:35:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2021-04-01 02:35:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2021-04-01 02:35:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2021-04-01 02:35:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2021-04-01 02:35:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2021-04-01 02:35:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2021-04-01 02:35:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2021-04-01 02:35:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2021-04-01 02:35:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2021-04-01 02:35:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2021-04-01 02:35:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2021-04-01 02:35:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2021-04-01 02:35:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2021-04-01 02:35:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2021-04-01 02:35:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2021-04-01 02:35:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2021-04-01 02:35:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2021-04-01 02:35:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2021-04-01 02:35:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2021-04-01 02:35:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2021-04-01 02:35:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2021-04-01 02:35:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2021-04-01 02:35:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2021-04-01 02:35:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2021-04-01 02:35:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2021-04-01 02:35:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2021-04-01 02:35:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2021-04-01 02:35:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2021-04-01 02:35:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2021-04-01 02:35:16 [INFO    ] All xbars set
2021-04-01 02:35:16 [INFO    ] Setting adder chain routing for all beams
2021-04-01 02:35:21 [INFO    ] Setting beam ids
2021-04-01 02:35:31 [INFO    ] Starting beam delay calibration
2021-04-01 02:35:43 [INFO    ] Beam 1 latency is 5728
2021-04-01 02:35:43 [INFO    ] Beam 2 latency is 5734
2021-04-01 02:35:43 [INFO    ] Beam 3 latency is 5733
2021-04-01 02:35:43 [INFO    ] Beam 4 latency is 5740
2021-04-01 02:35:43 [INFO    ] Stop calibration
2021-04-01 02:35:51 [INFO    ] Beam delay calibration successful
2021-04-01 02:35:51 [INFO    ] Calibration passed
2021-04-01 02:35:51 [DEBUG   ] spawn_process: at 2021-04-01 02:35:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2021-04-01 02:35:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2021-04-01 02:35:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2021-04-01 02:35:51 [DEBUG   ] spawn_process: at 2021-04-01 02:35:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2021-04-01 02:35:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2021-04-01 02:35:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2021-04-01 02:35:51 [DEBUG   ] spawn_process: at 2021-04-01 02:35:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2021-04-01 02:35:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2021-04-01 02:35:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2021-04-01 02:35:51 [DEBUG   ] spawn_process: at 2021-04-01 02:35:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2021-04-01 02:35:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2021-04-01 02:35:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2021-04-01 02:35:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2021-04-01 02:35:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 282 ms (1617244552.284 s) with PID 16545 and time 1617244553
2021-04-01 02:35:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2021-04-01 02:35:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 372 ms (1617244552.373 s) with PID 16548 and time 1617244553
2021-04-01 02:35:53 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2021-04-01 02:35:53 [INFO    ] Started antennas statistics background thread
2021-04-01 02:35:53 [INFO    ] Started board flags background thread
2021-04-01 02:35:53 [INFO    ] Started BAM background thread
2021-04-01 02:35:53 [INFO    ] Finished the INI process (ref. #10575) in 107.492 s
2021-04-01 02:35:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:35:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:35:54 [DEBUG   ] Finished updating board flags in 1.053 seconds
2021-04-01 02:36:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:36:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:36:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:36:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:36:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:36:54 [DEBUG   ] Finished updating board flags in 1.008 seconds
2021-04-01 02:37:06 [DEBUG   ] Got command RPT from MCS: ref #10600
2021-04-01 02:37:06 [DEBUG   ] summary = ERROR
2021-04-01 02:37:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10600  13 59305  9426005 A  ERRORERROR'
2021-04-01 02:37:06 [DEBUG   ] Got command RPT from MCS: ref #10601
2021-04-01 02:37:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:37:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10601  77 59305  9426005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:37:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 02:37:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:37:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:37:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:37:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:37:54 [DEBUG   ] Finished updating board flags in 1.040 seconds
2021-04-01 02:38:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:38:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:38:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 02:38:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:38:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:38:55 [DEBUG   ] Finished updating board flags in 1.895 seconds
2021-04-01 02:39:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:39:20 [DEBUG   ] Got command RPT from MCS: ref #10602
2021-04-01 02:39:20 [DEBUG   ] summary = ERROR
2021-04-01 02:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10602  13 59305  9560413 A  ERRORERROR'
2021-04-01 02:39:20 [DEBUG   ] Got command RPT from MCS: ref #10603
2021-04-01 02:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10603  77 59305  9560413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:39:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:39:50 [DEBUG   ] Got command RPT from MCS: ref #10623
2021-04-01 02:39:50 [DEBUG   ] summary = ERROR
2021-04-01 02:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10623  13 59305  9590085 A  ERRORERROR'
2021-04-01 02:39:50 [DEBUG   ] Got command RPT from MCS: ref #10625
2021-04-01 02:39:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10625  77 59305  9590277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:39:50 [DEBUG   ] Got command RPT from MCS: ref #10627
2021-04-01 02:39:50 [DEBUG   ] summary = ERROR
2021-04-01 02:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10627  13 59305  9590481 A  ERRORERROR'
2021-04-01 02:39:50 [DEBUG   ] Got command RPT from MCS: ref #10629
2021-04-01 02:39:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10629  77 59305  9590685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:39:50 [DEBUG   ] Got command RPT from MCS: ref #10632
2021-04-01 02:39:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10632  12 59305  9590877 A  ERRORB–™š'
2021-04-01 02:39:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:39:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:39:54 [DEBUG   ] Finished updating board flags in 1.165 seconds
2021-04-01 02:40:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:40:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:40:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:40:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:40:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:40:54 [DEBUG   ] Finished updating board flags in 1.046 seconds
2021-04-01 02:41:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:41:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:41:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:41:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:41:54 [DEBUG   ] Finished updating board flags in 1.013 seconds
2021-04-01 02:42:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:42:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:42:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 02:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:42:54 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:42:54 [DEBUG   ] Finished updating board flags in 0.954 seconds
2021-04-01 02:43:13 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 02:43:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:43:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:43:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:43:55 [DEBUG   ] Finished updating board flags in 1.363 seconds
2021-04-01 02:44:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:44:20 [DEBUG   ] Got command RPT from MCS: ref #10643
2021-04-01 02:44:20 [DEBUG   ] summary = ERROR
2021-04-01 02:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10643  13 59305  9860413 A  ERRORERROR'
2021-04-01 02:44:20 [DEBUG   ] Got command RPT from MCS: ref #10644
2021-04-01 02:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10644  77 59305  9860413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:44:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 02:44:50 [DEBUG   ] Got command RPT from MCS: ref #10660
2021-04-01 02:44:50 [DEBUG   ] summary = ERROR
2021-04-01 02:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10660  13 59305  9890149 A  ERRORERROR'
2021-04-01 02:44:50 [DEBUG   ] Got command RPT from MCS: ref #10661
2021-04-01 02:44:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10661  77 59305  9890353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:44:50 [DEBUG   ] Got command RPT from MCS: ref #10662
2021-04-01 02:44:50 [DEBUG   ] summary = ERROR
2021-04-01 02:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10662  13 59305  9890557 A  ERRORERROR'
2021-04-01 02:44:50 [DEBUG   ] Got command RPT from MCS: ref #10663
2021-04-01 02:44:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10663  77 59305  9890761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:44:50 [DEBUG   ] Got command RPT from MCS: ref #10664
2021-04-01 02:44:50 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:44:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10664  12 59305  9890953 A  ERRORB—™š'
2021-04-01 02:44:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:44:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:44:55 [DEBUG   ] Finished updating board flags in 1.247 seconds
2021-04-01 02:45:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:45:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:45:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:45:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:45:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:45:55 [DEBUG   ] Finished updating board flags in 1.214 seconds
2021-04-01 02:46:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:46:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:46:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:46:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:46:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:46:55 [DEBUG   ] Finished updating board flags in 1.160 seconds
2021-04-01 02:47:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:47:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:47:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:47:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:47:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:47:55 [DEBUG   ] Finished updating board flags in 1.015 seconds
2021-04-01 02:48:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:48:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 02:48:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:48:56 [DEBUG   ] Finished updating board flags in 2.009 seconds
2021-04-01 02:49:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:49:20 [DEBUG   ] Got command RPT from MCS: ref #10677
2021-04-01 02:49:20 [DEBUG   ] summary = ERROR
2021-04-01 02:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10677  13 59305 10160409 A  ERRORERROR'
2021-04-01 02:49:20 [DEBUG   ] Got command RPT from MCS: ref #10678
2021-04-01 02:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10678  77 59305 10160409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:49:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:49:50 [DEBUG   ] Got command RPT from MCS: ref #10696
2021-04-01 02:49:50 [DEBUG   ] summary = ERROR
2021-04-01 02:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10696  13 59305 10190233 A  ERRORERROR'
2021-04-01 02:49:50 [DEBUG   ] Got command RPT from MCS: ref #10697
2021-04-01 02:49:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10697  77 59305 10190425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:49:50 [DEBUG   ] Got command RPT from MCS: ref #10698
2021-04-01 02:49:50 [DEBUG   ] summary = ERROR
2021-04-01 02:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10698  13 59305 10190629 A  ERRORERROR'
2021-04-01 02:49:50 [DEBUG   ] Got command RPT from MCS: ref #10699
2021-04-01 02:49:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:49:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10699  77 59305 10190833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:49:51 [DEBUG   ] Got command RPT from MCS: ref #10701
2021-04-01 02:49:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10701  12 59305 10191025 A  ERRORB–™š'
2021-04-01 02:49:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-04-01 02:49:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:49:55 [DEBUG   ] Finished updating board flags in 1.407 seconds
2021-04-01 02:50:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:50:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:50:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:50:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:50:55 [DEBUG   ] Finished updating board flags in 1.472 seconds
2021-04-01 02:51:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 02:51:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:51:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:51:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:51:55 [DEBUG   ] Finished updating board flags in 1.354 seconds
2021-04-01 02:52:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:52:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:52:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:52:55 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:52:55 [DEBUG   ] Finished updating board flags in 1.226 seconds
2021-04-01 02:53:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:53:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:53:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:53:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:53:56 [DEBUG   ] Finished updating board flags in 1.764 seconds
2021-04-01 02:54:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:54:20 [DEBUG   ] Got command RPT from MCS: ref #10712
2021-04-01 02:54:20 [DEBUG   ] summary = ERROR
2021-04-01 02:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10712  13 59305 10460417 A  ERRORERROR'
2021-04-01 02:54:20 [DEBUG   ] Got command RPT from MCS: ref #10713
2021-04-01 02:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10713  77 59305 10460417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:54:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:54:50 [DEBUG   ] Got command RPT from MCS: ref #10735
2021-04-01 02:54:50 [DEBUG   ] summary = ERROR
2021-04-01 02:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10735  13 59305 10490301 A  ERRORERROR'
2021-04-01 02:54:50 [DEBUG   ] Got command RPT from MCS: ref #10737
2021-04-01 02:54:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10737  77 59305 10490505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:54:50 [DEBUG   ] Got command RPT from MCS: ref #10739
2021-04-01 02:54:50 [DEBUG   ] summary = ERROR
2021-04-01 02:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10739  13 59305 10490697 A  ERRORERROR'
2021-04-01 02:54:50 [DEBUG   ] Got command RPT from MCS: ref #10741
2021-04-01 02:54:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10741  77 59305 10490901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:54:51 [DEBUG   ] Got command RPT from MCS: ref #10743
2021-04-01 02:54:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10743  12 59305 10491105 A  ERRORB—™š'
2021-04-01 02:54:53 [DEBUG   ] Got command DRX from MCS: ref #10745
2021-04-01 02:54:53 [INFO    ] sending drx command to lwa16
2021-04-01 02:54:53 [DEBUG   ] run_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 0']
2021-04-01 02:54:53 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 02:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    10745   8 59305 10493009 A  ERROR'
2021-04-01 02:54:53 [DEBUG   ] Got command DRX from MCS: ref #10744
2021-04-01 02:54:53 [INFO    ] sending drx command to lwa34
2021-04-01 02:54:53 [DEBUG   ] run_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2021-04-01 02:54:53 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 02:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    10744   8 59305 10493013 A  ERROR'
2021-04-01 02:54:53 [DEBUG   ] Got command DRX from MCS: ref #10746
2021-04-01 02:54:53 [INFO    ] sending drx command to lwa34
2021-04-01 02:54:53 [DEBUG   ] run_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2021-04-01 02:54:53 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 02:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    10746   8 59305 10493017 A  ERROR'
2021-04-01 02:54:53 [DEBUG   ] Got command DRX from MCS: ref #10747
2021-04-01 02:54:53 [INFO    ] sending drx command to lwa16
2021-04-01 02:54:53 [DEBUG   ] run_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 0']
2021-04-01 02:54:53 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 02:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    10747   8 59305 10493021 A  ERROR'
2021-04-01 02:54:53 [DEBUG   ] Got command BAM from MCS: ref #10748
2021-04-01 02:54:53 [INFO    ] Finished processing BAM request
2021-04-01 02:54:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10748   8 59305 10493025 A  ERROR'
2021-04-01 02:54:53 [DEBUG   ] Got command BAM from MCS: ref #10749
2021-04-01 02:54:53 [INFO    ] Finished processing BAM request
2021-04-01 02:54:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10749   8 59305 10493029 A  ERROR'
2021-04-01 02:54:53 [INFO    ] Finished starting DRX
2021-04-01 02:54:53 [INFO    ] Finished starting DRX
2021-04-01 02:54:53 [INFO    ] Finished starting DRX
2021-04-01 02:54:53 [INFO    ] Finished starting DRX
2021-04-01 02:54:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 02:54:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 02:54:53 [DEBUG   ] spawn_process: at 2021-04-01 02:54:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 02:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:54:56 [DEBUG   ] Finished updating board flags in 1.545 seconds
2021-04-01 02:55:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:55:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 02:55:42 [DEBUG   ] Got command BAM from MCS: ref #10752
2021-04-01 02:55:42 [INFO    ] Finished processing BAM request
2021-04-01 02:55:42 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:55:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10752   8 59305 10542033 A  ERROR'
2021-04-01 02:55:42 [DEBUG   ] Got command BAM from MCS: ref #10753
2021-04-01 02:55:42 [INFO    ] Finished processing BAM request
2021-04-01 02:55:42 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:55:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10753   8 59305 10542037 A  ERROR'
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 02:55:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 02:55:42 [DEBUG   ] spawn_process: at 2021-04-01 02:55:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 02:55:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 02:55:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 02:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:55:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:55:56 [DEBUG   ] Finished updating board flags in 1.418 seconds
2021-04-01 02:56:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:56:31 [DEBUG   ] Got command BAM from MCS: ref #10755
2021-04-01 02:56:31 [INFO    ] Finished processing BAM request
2021-04-01 02:56:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:56:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10755   8 59305 10591029 A  ERROR'
2021-04-01 02:56:31 [DEBUG   ] Got command BAM from MCS: ref #10754
2021-04-01 02:56:31 [INFO    ] Finished processing BAM request
2021-04-01 02:56:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:56:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10754   8 59305 10591033 A  ERROR'
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 02:56:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 02:56:31 [DEBUG   ] spawn_process: at 2021-04-01 02:56:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 02:56:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:56:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:56:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:56:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:56:56 [DEBUG   ] Finished updating board flags in 1.392 seconds
2021-04-01 02:57:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:57:20 [DEBUG   ] Got command BAM from MCS: ref #10756
2021-04-01 02:57:20 [INFO    ] Finished processing BAM request
2021-04-01 02:57:20 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10756   8 59305 10640025 A  ERROR'
2021-04-01 02:57:20 [DEBUG   ] Got command BAM from MCS: ref #10757
2021-04-01 02:57:20 [INFO    ] Finished processing BAM request
2021-04-01 02:57:20 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:57:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10757   8 59305 10640029 A  ERROR'
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 02:57:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 02:57:20 [DEBUG   ] spawn_process: at 2021-04-01 02:57:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 02:57:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 02:57:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:57:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:57:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 02:57:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:57:56 [DEBUG   ] Finished updating board flags in 1.239 seconds
2021-04-01 02:58:09 [DEBUG   ] Got command BAM from MCS: ref #10765
2021-04-01 02:58:09 [INFO    ] Finished processing BAM request
2021-04-01 02:58:09 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10765   8 59305 10689033 A  ERROR'
2021-04-01 02:58:09 [DEBUG   ] Got command BAM from MCS: ref #10764
2021-04-01 02:58:09 [INFO    ] Finished processing BAM request
2021-04-01 02:58:09 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:58:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10764   8 59305 10689037 A  ERROR'
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 02:58:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 02:58:09 [DEBUG   ] spawn_process: at 2021-04-01 02:58:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 02:58:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:58:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:58:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:58:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:58:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 02:58:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 02:58:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:58:56 [DEBUG   ] Finished updating board flags in 1.213 seconds
2021-04-01 02:58:58 [DEBUG   ] Got command BAM from MCS: ref #10766
2021-04-01 02:58:58 [INFO    ] Finished processing BAM request
2021-04-01 02:58:58 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10766   8 59305 10738025 A  ERROR'
2021-04-01 02:58:58 [DEBUG   ] Got command BAM from MCS: ref #10767
2021-04-01 02:58:58 [INFO    ] Finished processing BAM request
2021-04-01 02:58:58 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:58:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10767   8 59305 10738029 A  ERROR'
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 02:58:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 02:58:58 [DEBUG   ] spawn_process: at 2021-04-01 02:58:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 02:59:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:59:20 [DEBUG   ] Got command RPT from MCS: ref #10768
2021-04-01 02:59:20 [DEBUG   ] summary = ERROR
2021-04-01 02:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10768  13 59305 10760409 A  ERRORERROR'
2021-04-01 02:59:20 [DEBUG   ] Got command RPT from MCS: ref #10769
2021-04-01 02:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10769  77 59305 10760409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:59:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:59:47 [DEBUG   ] Got command BAM from MCS: ref #10786
2021-04-01 02:59:47 [INFO    ] Finished processing BAM request
2021-04-01 02:59:47 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10786   8 59305 10787029 A  ERROR'
2021-04-01 02:59:47 [DEBUG   ] Got command BAM from MCS: ref #10785
2021-04-01 02:59:47 [INFO    ] Finished processing BAM request
2021-04-01 02:59:47 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 02:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10785   8 59305 10787033 A  ERROR'
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 02:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 02:59:47 [DEBUG   ] spawn_process: at 2021-04-01 02:59:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 02:59:50 [DEBUG   ] Got command RPT from MCS: ref #10789
2021-04-01 02:59:50 [DEBUG   ] summary = ERROR
2021-04-01 02:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10789  13 59305 10790369 A  ERRORERROR'
2021-04-01 02:59:50 [DEBUG   ] Got command RPT from MCS: ref #10790
2021-04-01 02:59:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10790  77 59305 10790573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:59:50 [DEBUG   ] Got command RPT from MCS: ref #10791
2021-04-01 02:59:50 [DEBUG   ] summary = ERROR
2021-04-01 02:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10791  13 59305 10790777 A  ERRORERROR'
2021-04-01 02:59:50 [DEBUG   ] Got command RPT from MCS: ref #10792
2021-04-01 02:59:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 02:59:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10792  77 59305 10790981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 02:59:51 [DEBUG   ] Got command RPT from MCS: ref #10794
2021-04-01 02:59:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 02:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10794  12 59305 10791173 A  ERRORB ff'
2021-04-01 02:59:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 02:59:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 02:59:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 02:59:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 02:59:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 02:59:56 [DEBUG   ] Finished updating board flags in 1.156 seconds
2021-04-01 03:00:13 [DEBUG   ] Finished updating ant stats in 0.390 seconds
2021-04-01 03:00:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:00:36 [DEBUG   ] Got command BAM from MCS: ref #10800
2021-04-01 03:00:36 [INFO    ] Finished processing BAM request
2021-04-01 03:00:36 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10800   8 59305 10836033 A  ERROR'
2021-04-01 03:00:36 [DEBUG   ] Got command BAM from MCS: ref #10799
2021-04-01 03:00:36 [INFO    ] Finished processing BAM request
2021-04-01 03:00:36 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10799   8 59305 10836037 A  ERROR'
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 03:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 03:00:36 [DEBUG   ] spawn_process: at 2021-04-01 03:00:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 03:00:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:00:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:00:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 03:00:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:00:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:00:56 [DEBUG   ] Finished updating board flags in 1.002 seconds
2021-04-01 03:01:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:01:25 [DEBUG   ] Got command BAM from MCS: ref #10808
2021-04-01 03:01:25 [INFO    ] Finished processing BAM request
2021-04-01 03:01:25 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:01:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10808   8 59305 10885025 A  ERROR'
2021-04-01 03:01:25 [DEBUG   ] Got command BAM from MCS: ref #10807
2021-04-01 03:01:25 [INFO    ] Finished processing BAM request
2021-04-01 03:01:25 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:01:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10807   8 59305 10885029 A  ERROR'
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:01:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:01:25 [DEBUG   ] spawn_process: at 2021-04-01 03:01:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:01:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:01:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:01:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:01:56 [DEBUG   ] Finished updating board flags in 1.056 seconds
2021-04-01 03:02:14 [DEBUG   ] Got command BAM from MCS: ref #10810
2021-04-01 03:02:14 [INFO    ] Finished processing BAM request
2021-04-01 03:02:14 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10810   8 59305 10934029 A  ERROR'
2021-04-01 03:02:14 [DEBUG   ] Got command BAM from MCS: ref #10809
2021-04-01 03:02:14 [INFO    ] Finished processing BAM request
2021-04-01 03:02:14 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:02:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10809   8 59305 10934033 A  ERROR'
2021-04-01 03:02:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:02:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:02:14 [DEBUG   ] spawn_process: at 2021-04-01 03:02:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:02:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:02:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:02:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:02:56 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:02:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:02:56 [DEBUG   ] Finished updating board flags in 1.454 seconds
2021-04-01 03:03:03 [DEBUG   ] Got command BAM from MCS: ref #10811
2021-04-01 03:03:03 [INFO    ] Finished processing BAM request
2021-04-01 03:03:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10811   8 59305 10983029 A  ERROR'
2021-04-01 03:03:03 [DEBUG   ] Got command BAM from MCS: ref #10812
2021-04-01 03:03:03 [INFO    ] Finished processing BAM request
2021-04-01 03:03:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:03:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10812   8 59305 10983033 A  ERROR'
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 03:03:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 03:03:03 [DEBUG   ] spawn_process: at 2021-04-01 03:03:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 03:03:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:03:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:03:52 [DEBUG   ] Got command BAM from MCS: ref #10818
2021-04-01 03:03:52 [INFO    ] Finished processing BAM request
2021-04-01 03:03:52 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:03:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10818   8 59305 11032029 A  ERROR'
2021-04-01 03:03:52 [DEBUG   ] Got command BAM from MCS: ref #10819
2021-04-01 03:03:52 [INFO    ] Finished processing BAM request
2021-04-01 03:03:52 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:03:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10819   8 59305 11032033 A  ERROR'
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 03:03:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 03:03:52 [DEBUG   ] spawn_process: at 2021-04-01 03:03:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 03:03:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 03:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:03:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 03:03:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 03:03:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:03:56 [DEBUG   ] Finished updating board flags in 1.409 seconds
2021-04-01 03:04:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 03:04:20 [DEBUG   ] Got command RPT from MCS: ref #10821
2021-04-01 03:04:20 [DEBUG   ] summary = ERROR
2021-04-01 03:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10821  13 59305 11060417 A  ERRORERROR'
2021-04-01 03:04:20 [DEBUG   ] Got command RPT from MCS: ref #10822
2021-04-01 03:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10822  77 59305 11060417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:04:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:04:41 [DEBUG   ] Got command BAM from MCS: ref #10838
2021-04-01 03:04:41 [INFO    ] Finished processing BAM request
2021-04-01 03:04:41 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10838   8 59305 11081025 A  ERROR'
2021-04-01 03:04:41 [DEBUG   ] Got command BAM from MCS: ref #10839
2021-04-01 03:04:41 [INFO    ] Finished processing BAM request
2021-04-01 03:04:41 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:04:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10839   8 59305 11081029 A  ERROR'
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 03:04:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 03:04:41 [DEBUG   ] spawn_process: at 2021-04-01 03:04:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 03:04:50 [DEBUG   ] Got command RPT from MCS: ref #10840
2021-04-01 03:04:50 [DEBUG   ] summary = ERROR
2021-04-01 03:04:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10840  13 59305 11090449 A  ERRORERROR'
2021-04-01 03:04:50 [DEBUG   ] Got command RPT from MCS: ref #10841
2021-04-01 03:04:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:04:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10841  77 59305 11090653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:04:50 [DEBUG   ] Got command RPT from MCS: ref #10842
2021-04-01 03:04:50 [DEBUG   ] summary = ERROR
2021-04-01 03:04:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10842  13 59305 11090845 A  ERRORERROR'
2021-04-01 03:04:51 [DEBUG   ] Got command RPT from MCS: ref #10843
2021-04-01 03:04:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10843  77 59305 11091049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:04:51 [DEBUG   ] Got command RPT from MCS: ref #10844
2021-04-01 03:04:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10844  12 59305 11091253 A  ERRORB¡ff'
2021-04-01 03:04:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:04:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 03:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:04:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 03:04:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 03:04:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:04:56 [DEBUG   ] Finished updating board flags in 1.335 seconds
2021-04-01 03:05:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:05:30 [DEBUG   ] Got command BAM from MCS: ref #10846
2021-04-01 03:05:30 [INFO    ] Finished processing BAM request
2021-04-01 03:05:30 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10846   8 59305 11130029 A  ERROR'
2021-04-01 03:05:30 [DEBUG   ] Got command BAM from MCS: ref #10845
2021-04-01 03:05:30 [INFO    ] Finished processing BAM request
2021-04-01 03:05:30 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:05:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10845   8 59305 11130033 A  ERROR'
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 03:05:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 03:05:30 [DEBUG   ] spawn_process: at 2021-04-01 03:05:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 03:05:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:05:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:05:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 03:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:05:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:05:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:05:56 [DEBUG   ] Finished updating board flags in 1.225 seconds
2021-04-01 03:06:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:06:19 [DEBUG   ] Got command BAM from MCS: ref #10848
2021-04-01 03:06:19 [INFO    ] Finished processing BAM request
2021-04-01 03:06:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10848   8 59305 11179025 A  ERROR'
2021-04-01 03:06:19 [DEBUG   ] Got command BAM from MCS: ref #10847
2021-04-01 03:06:19 [INFO    ] Finished processing BAM request
2021-04-01 03:06:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10847   8 59305 11179029 A  ERROR'
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 03:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 03:06:19 [DEBUG   ] spawn_process: at 2021-04-01 03:06:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 03:06:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:06:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:06:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:06:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 03:06:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:06:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2021-04-01 03:06:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:06:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:06:57 [DEBUG   ] Finished updating board flags in 1.751 seconds
2021-04-01 03:07:08 [DEBUG   ] Got command BAM from MCS: ref #10856
2021-04-01 03:07:08 [INFO    ] Finished processing BAM request
2021-04-01 03:07:08 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10856   8 59305 11228053 A  ERROR'
2021-04-01 03:07:08 [DEBUG   ] Got command BAM from MCS: ref #10855
2021-04-01 03:07:08 [INFO    ] Finished processing BAM request
2021-04-01 03:07:08 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:07:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10855   8 59305 11228057 A  ERROR'
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 03:07:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 03:07:08 [DEBUG   ] spawn_process: at 2021-04-01 03:07:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 03:07:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:07:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:07:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:07:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2021-04-01 03:07:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:07:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:07:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:07:56 [DEBUG   ] Finished updating board flags in 1.039 seconds
2021-04-01 03:07:57 [DEBUG   ] Got command BAM from MCS: ref #10858
2021-04-01 03:07:57 [INFO    ] Finished processing BAM request
2021-04-01 03:07:57 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:07:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10858   8 59305 11277033 A  ERROR'
2021-04-01 03:07:57 [DEBUG   ] Got command BAM from MCS: ref #10857
2021-04-01 03:07:57 [INFO    ] Finished processing BAM request
2021-04-01 03:07:57 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:07:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10857   8 59305 11277037 A  ERROR'
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 03:07:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 03:07:57 [DEBUG   ] spawn_process: at 2021-04-01 03:07:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 03:08:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:08:34 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2021-04-01 03:08:46 [DEBUG   ] Got command BAM from MCS: ref #10859
2021-04-01 03:08:46 [INFO    ] Finished processing BAM request
2021-04-01 03:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10859   8 59305 11326025 A  ERROR'
2021-04-01 03:08:46 [DEBUG   ] Got command BAM from MCS: ref #10860
2021-04-01 03:08:46 [INFO    ] Finished processing BAM request
2021-04-01 03:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10860   8 59305 11326029 A  ERROR'
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 03:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 03:08:46 [DEBUG   ] spawn_process: at 2021-04-01 03:08:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 03:08:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:08:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:08:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 03:08:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 03:08:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:08:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:08:56 [DEBUG   ] Finished updating board flags in 1.013 seconds
2021-04-01 03:09:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:09:20 [DEBUG   ] Got command RPT from MCS: ref #10861
2021-04-01 03:09:20 [DEBUG   ] summary = ERROR
2021-04-01 03:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10861  13 59305 11360409 A  ERRORERROR'
2021-04-01 03:09:20 [DEBUG   ] Got command RPT from MCS: ref #10862
2021-04-01 03:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10862  77 59305 11360409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:09:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:09:35 [DEBUG   ] Got command BAM from MCS: ref #10879
2021-04-01 03:09:35 [INFO    ] Finished processing BAM request
2021-04-01 03:09:35 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:09:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10879   8 59305 11375029 A  ERROR'
2021-04-01 03:09:35 [DEBUG   ] Got command BAM from MCS: ref #10878
2021-04-01 03:09:35 [INFO    ] Finished processing BAM request
2021-04-01 03:09:35 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:09:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10878   8 59305 11375033 A  ERROR'
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 03:09:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 03:09:35 [DEBUG   ] spawn_process: at 2021-04-01 03:09:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 03:09:50 [DEBUG   ] Got command RPT from MCS: ref #10884
2021-04-01 03:09:50 [DEBUG   ] summary = ERROR
2021-04-01 03:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10884  13 59305 11390525 A  ERRORERROR'
2021-04-01 03:09:50 [DEBUG   ] Got command RPT from MCS: ref #10886
2021-04-01 03:09:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10886  77 59305 11390717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:09:50 [DEBUG   ] Got command RPT from MCS: ref #10888
2021-04-01 03:09:50 [DEBUG   ] summary = ERROR
2021-04-01 03:09:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10888  13 59305 11390921 A  ERRORERROR'
2021-04-01 03:09:51 [DEBUG   ] Got command RPT from MCS: ref #10890
2021-04-01 03:09:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10890  77 59305 11391125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:09:51 [DEBUG   ] Got command RPT from MCS: ref #10893
2021-04-01 03:09:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10893  12 59305 11391329 A  ERRORB¢ff'
2021-04-01 03:09:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:09:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:09:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:09:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 03:09:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:09:56 [DEBUG   ] Finished updating board flags in 0.975 seconds
2021-04-01 03:10:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:10:24 [DEBUG   ] Got command BAM from MCS: ref #10898
2021-04-01 03:10:24 [INFO    ] Finished processing BAM request
2021-04-01 03:10:24 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:10:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10898   8 59305 11424033 A  ERROR'
2021-04-01 03:10:24 [DEBUG   ] Got command BAM from MCS: ref #10899
2021-04-01 03:10:24 [INFO    ] Finished processing BAM request
2021-04-01 03:10:24 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:10:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10899   8 59305 11424037 A  ERROR'
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:10:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:10:24 [DEBUG   ] spawn_process: at 2021-04-01 03:10:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:10:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:10:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:10:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 03:10:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 03:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:10:57 [DEBUG   ] Finished updating board flags in 1.372 seconds
2021-04-01 03:11:13 [DEBUG   ] Got command BAM from MCS: ref #10900
2021-04-01 03:11:13 [INFO    ] Finished processing BAM request
2021-04-01 03:11:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10900   8 59305 11473033 A  ERROR'
2021-04-01 03:11:13 [DEBUG   ] Got command BAM from MCS: ref #10901
2021-04-01 03:11:13 [INFO    ] Finished processing BAM request
2021-04-01 03:11:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10901   8 59305 11473037 A  ERROR'
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:11:13 [DEBUG   ] spawn_process: at 2021-04-01 03:11:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:11:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:11:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:11:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:11:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:11:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:11:57 [DEBUG   ] Finished updating board flags in 1.228 seconds
2021-04-01 03:12:02 [DEBUG   ] Got command BAM from MCS: ref #10903
2021-04-01 03:12:02 [INFO    ] Finished processing BAM request
2021-04-01 03:12:02 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10903   8 59305 11522029 A  ERROR'
2021-04-01 03:12:02 [DEBUG   ] Got command BAM from MCS: ref #10902
2021-04-01 03:12:02 [INFO    ] Finished processing BAM request
2021-04-01 03:12:02 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:12:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10902   8 59305 11522033 A  ERROR'
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 03:12:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 03:12:02 [DEBUG   ] spawn_process: at 2021-04-01 03:12:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 03:12:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 03:12:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:12:51 [DEBUG   ] Got command BAM from MCS: ref #10905
2021-04-01 03:12:51 [INFO    ] Finished processing BAM request
2021-04-01 03:12:51 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:12:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10905   8 59305 11571025 A  ERROR'
2021-04-01 03:12:51 [DEBUG   ] Got command BAM from MCS: ref #10904
2021-04-01 03:12:51 [INFO    ] Finished processing BAM request
2021-04-01 03:12:51 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:12:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10904   8 59305 11571029 A  ERROR'
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 03:12:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 03:12:51 [DEBUG   ] spawn_process: at 2021-04-01 03:12:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 03:12:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:12:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:12:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 03:12:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 03:12:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:12:57 [DEBUG   ] Finished updating board flags in 1.206 seconds
2021-04-01 03:13:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:13:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:13:40 [DEBUG   ] Got command BAM from MCS: ref #10913
2021-04-01 03:13:40 [INFO    ] Finished processing BAM request
2021-04-01 03:13:40 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10913   8 59305 11620029 A  ERROR'
2021-04-01 03:13:40 [DEBUG   ] Got command BAM from MCS: ref #10912
2021-04-01 03:13:40 [INFO    ] Finished processing BAM request
2021-04-01 03:13:40 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10912   8 59305 11620033 A  ERROR'
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 03:13:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 03:13:40 [DEBUG   ] spawn_process: at 2021-04-01 03:13:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 03:13:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:13:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 03:13:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 03:13:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:13:57 [DEBUG   ] Finished updating board flags in 1.158 seconds
2021-04-01 03:14:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 03:14:20 [DEBUG   ] Got command RPT from MCS: ref #10914
2021-04-01 03:14:20 [DEBUG   ] summary = ERROR
2021-04-01 03:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10914  13 59305 11660413 A  ERRORERROR'
2021-04-01 03:14:20 [DEBUG   ] Got command RPT from MCS: ref #10915
2021-04-01 03:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10915  77 59305 11660413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:14:29 [DEBUG   ] Got command BAM from MCS: ref #10931
2021-04-01 03:14:29 [INFO    ] Finished processing BAM request
2021-04-01 03:14:29 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10931   8 59305 11669033 A  ERROR'
2021-04-01 03:14:29 [DEBUG   ] Got command BAM from MCS: ref #10932
2021-04-01 03:14:29 [INFO    ] Finished processing BAM request
2021-04-01 03:14:29 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10932   8 59305 11669037 A  ERROR'
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 03:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 03:14:29 [DEBUG   ] spawn_process: at 2021-04-01 03:14:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 03:14:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:14:50 [DEBUG   ] Got command RPT from MCS: ref #10933
2021-04-01 03:14:50 [DEBUG   ] summary = ERROR
2021-04-01 03:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10933  13 59305 11690597 A  ERRORERROR'
2021-04-01 03:14:50 [DEBUG   ] Got command RPT from MCS: ref #10934
2021-04-01 03:14:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10934  77 59305 11690801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:14:50 [DEBUG   ] Got command RPT from MCS: ref #10935
2021-04-01 03:14:50 [DEBUG   ] summary = ERROR
2021-04-01 03:14:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10935  13 59305 11690993 A  ERRORERROR'
2021-04-01 03:14:51 [DEBUG   ] Got command RPT from MCS: ref #10936
2021-04-01 03:14:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10936  77 59305 11691197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:14:51 [DEBUG   ] Got command RPT from MCS: ref #10937
2021-04-01 03:14:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10937  12 59305 11691401 A  ERRORB¡ff'
2021-04-01 03:14:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:14:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 03:14:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 03:14:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:14:57 [DEBUG   ] Finished updating board flags in 1.012 seconds
2021-04-01 03:15:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:15:18 [DEBUG   ] Got command BAM from MCS: ref #10939
2021-04-01 03:15:18 [INFO    ] Finished processing BAM request
2021-04-01 03:15:18 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10939   8 59305 11718033 A  ERROR'
2021-04-01 03:15:18 [DEBUG   ] Got command BAM from MCS: ref #10938
2021-04-01 03:15:18 [INFO    ] Finished processing BAM request
2021-04-01 03:15:18 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:15:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10938   8 59305 11718037 A  ERROR'
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 03:15:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 03:15:18 [DEBUG   ] spawn_process: at 2021-04-01 03:15:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 03:15:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:15:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 03:15:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:15:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 03:15:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 03:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:15:57 [DEBUG   ] Finished updating board flags in 1.035 seconds
2021-04-01 03:16:07 [DEBUG   ] Got command BAM from MCS: ref #10946
2021-04-01 03:16:07 [INFO    ] Finished processing BAM request
2021-04-01 03:16:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10946   8 59305 11767045 A  ERROR'
2021-04-01 03:16:07 [DEBUG   ] Got command BAM from MCS: ref #10947
2021-04-01 03:16:07 [INFO    ] Finished processing BAM request
2021-04-01 03:16:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10947   8 59305 11767049 A  ERROR'
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 03:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 03:16:07 [DEBUG   ] spawn_process: at 2021-04-01 03:16:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 03:16:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:16:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:16:54 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 03:16:56 [DEBUG   ] Got command BAM from MCS: ref #10949
2021-04-01 03:16:56 [INFO    ] Finished processing BAM request
2021-04-01 03:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10949   8 59305 11816025 A  ERROR'
2021-04-01 03:16:56 [DEBUG   ] Got command BAM from MCS: ref #10948
2021-04-01 03:16:56 [INFO    ] Finished processing BAM request
2021-04-01 03:16:56 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:16:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10948   8 59305 11816029 A  ERROR'
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 03:16:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 03:16:56 [DEBUG   ] spawn_process: at 2021-04-01 03:16:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 03:16:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:16:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:16:57 [DEBUG   ] Finished updating board flags in 1.464 seconds
2021-04-01 03:17:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:17:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:17:45 [DEBUG   ] Got command BAM from MCS: ref #10951
2021-04-01 03:17:45 [INFO    ] Finished processing BAM request
2021-04-01 03:17:45 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:17:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10951   8 59305 11865033 A  ERROR'
2021-04-01 03:17:45 [DEBUG   ] Got command BAM from MCS: ref #10950
2021-04-01 03:17:45 [INFO    ] Finished processing BAM request
2021-04-01 03:17:45 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:17:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10950   8 59305 11865037 A  ERROR'
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:17:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:17:45 [DEBUG   ] spawn_process: at 2021-04-01 03:17:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:17:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:17:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:17:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 03:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:17:58 [DEBUG   ] Finished updating board flags in 1.950 seconds
2021-04-01 03:18:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:18:34 [DEBUG   ] Got command BAM from MCS: ref #10952
2021-04-01 03:18:34 [INFO    ] Finished processing BAM request
2021-04-01 03:18:34 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10952   8 59305 11914033 A  ERROR'
2021-04-01 03:18:34 [DEBUG   ] Got command BAM from MCS: ref #10953
2021-04-01 03:18:34 [INFO    ] Finished processing BAM request
2021-04-01 03:18:34 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10953   8 59305 11914037 A  ERROR'
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:18:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:18:34 [DEBUG   ] spawn_process: at 2021-04-01 03:18:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:18:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:18:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 03:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:18:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:18:58 [DEBUG   ] Finished updating board flags in 1.811 seconds
2021-04-01 03:19:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:19:20 [DEBUG   ] Got command RPT from MCS: ref #10960
2021-04-01 03:19:20 [DEBUG   ] summary = ERROR
2021-04-01 03:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10960  13 59305 11960417 A  ERRORERROR'
2021-04-01 03:19:20 [DEBUG   ] Got command RPT from MCS: ref #10961
2021-04-01 03:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10961  77 59305 11960417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:19:23 [DEBUG   ] Got command BAM from MCS: ref #10978
2021-04-01 03:19:23 [INFO    ] Finished processing BAM request
2021-04-01 03:19:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:19:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10978   8 59305 11963025 A  ERROR'
2021-04-01 03:19:23 [DEBUG   ] Got command BAM from MCS: ref #10977
2021-04-01 03:19:23 [INFO    ] Finished processing BAM request
2021-04-01 03:19:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:19:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10977   8 59305 11963029 A  ERROR'
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 03:19:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 03:19:23 [DEBUG   ] spawn_process: at 2021-04-01 03:19:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 03:19:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:19:50 [DEBUG   ] Got command RPT from MCS: ref #10981
2021-04-01 03:19:50 [DEBUG   ] summary = ERROR
2021-04-01 03:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10981  13 59305 11990673 A  ERRORERROR'
2021-04-01 03:19:50 [DEBUG   ] Got command RPT from MCS: ref #10982
2021-04-01 03:19:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:19:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10982  77 59305 11990877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:19:51 [DEBUG   ] Got command RPT from MCS: ref #10983
2021-04-01 03:19:51 [DEBUG   ] summary = ERROR
2021-04-01 03:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10983  13 59305 11991069 A  ERRORERROR'
2021-04-01 03:19:51 [DEBUG   ] Got command RPT from MCS: ref #10984
2021-04-01 03:19:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10984  77 59305 11991273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:19:51 [DEBUG   ] Got command RPT from MCS: ref #10986
2021-04-01 03:19:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10986  12 59305 11991477 A  ERRORB ff'
2021-04-01 03:19:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:19:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:19:57 [DEBUG   ] Finished updating board flags in 1.197 seconds
2021-04-01 03:20:12 [DEBUG   ] Got command BAM from MCS: ref #10991
2021-04-01 03:20:12 [INFO    ] Finished processing BAM request
2021-04-01 03:20:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10991   8 59305 12012029 A  ERROR'
2021-04-01 03:20:12 [DEBUG   ] Got command BAM from MCS: ref #10992
2021-04-01 03:20:12 [INFO    ] Finished processing BAM request
2021-04-01 03:20:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:20:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10992   8 59305 12012033 A  ERROR'
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 03:20:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 03:20:12 [DEBUG   ] spawn_process: at 2021-04-01 03:20:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 03:20:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:20:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:20:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:20:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 03:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:20:57 [DEBUG   ] Finished updating board flags in 1.067 seconds
2021-04-01 03:21:01 [DEBUG   ] Got command BAM from MCS: ref #10994
2021-04-01 03:21:01 [INFO    ] Finished processing BAM request
2021-04-01 03:21:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:21:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10994   8 59305 12061033 A  ERROR'
2021-04-01 03:21:01 [DEBUG   ] Got command BAM from MCS: ref #10993
2021-04-01 03:21:01 [INFO    ] Finished processing BAM request
2021-04-01 03:21:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:21:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10993   8 59305 12061037 A  ERROR'
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 03:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 03:21:01 [DEBUG   ] spawn_process: at 2021-04-01 03:21:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 03:21:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 03:21:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:21:50 [DEBUG   ] Got command BAM from MCS: ref #10996
2021-04-01 03:21:50 [INFO    ] Finished processing BAM request
2021-04-01 03:21:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10996   8 59305 12110029 A  ERROR'
2021-04-01 03:21:50 [DEBUG   ] Got command BAM from MCS: ref #10995
2021-04-01 03:21:50 [INFO    ] Finished processing BAM request
2021-04-01 03:21:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10995   8 59305 12110033 A  ERROR'
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:21:50 [DEBUG   ] spawn_process: at 2021-04-01 03:21:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:21:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:21:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:21:57 [DEBUG   ] Finished updating board flags in 0.927 seconds
2021-04-01 03:22:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:22:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:22:39 [DEBUG   ] Got command BAM from MCS: ref #11004
2021-04-01 03:22:39 [INFO    ] Finished processing BAM request
2021-04-01 03:22:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    11004   8 59305 12159025 A  ERROR'
2021-04-01 03:22:39 [DEBUG   ] Got command BAM from MCS: ref #11003
2021-04-01 03:22:39 [INFO    ] Finished processing BAM request
2021-04-01 03:22:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:22:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    11003   8 59305 12159029 A  ERROR'
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:22:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:22:39 [DEBUG   ] spawn_process: at 2021-04-01 03:22:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:22:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 03:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 03:22:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 03:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:22:58 [DEBUG   ] Finished updating board flags in 1.369 seconds
2021-04-01 03:23:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:23:28 [DEBUG   ] Got command BAM from MCS: ref #11005
2021-04-01 03:23:28 [INFO    ] Finished processing BAM request
2021-04-01 03:23:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    11005   8 59305 12208029 A  ERROR'
2021-04-01 03:23:28 [DEBUG   ] Got command BAM from MCS: ref #11006
2021-04-01 03:23:28 [INFO    ] Finished processing BAM request
2021-04-01 03:23:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    11006   8 59305 12208033 A  ERROR'
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:23:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:23:28 [DEBUG   ] spawn_process: at 2021-04-01 03:23:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:23:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:23:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:23:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 03:23:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:23:58 [DEBUG   ] Finished updating board flags in 1.210 seconds
2021-04-01 03:24:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:24:17 [DEBUG   ] Got command BAM from MCS: ref #11008
2021-04-01 03:24:17 [INFO    ] Finished processing BAM request
2021-04-01 03:24:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    11008   8 59305 12257033 A  ERROR'
2021-04-01 03:24:17 [DEBUG   ] Got command BAM from MCS: ref #11007
2021-04-01 03:24:17 [INFO    ] Finished processing BAM request
2021-04-01 03:24:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 03:24:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    11007   8 59305 12257037 A  ERROR'
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 03:24:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 03:24:17 [DEBUG   ] spawn_process: at 2021-04-01 03:24:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 03:24:20 [DEBUG   ] Got command RPT from MCS: ref #11009
2021-04-01 03:24:20 [DEBUG   ] summary = ERROR
2021-04-01 03:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11009  13 59305 12260421 A  ERRORERROR'
2021-04-01 03:24:20 [DEBUG   ] Got command RPT from MCS: ref #11010
2021-04-01 03:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11010  77 59305 12260421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:24:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 03:24:50 [DEBUG   ] Got command RPT from MCS: ref #11028
2021-04-01 03:24:50 [DEBUG   ] summary = ERROR
2021-04-01 03:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11028  13 59305 12290749 A  ERRORERROR'
2021-04-01 03:24:50 [DEBUG   ] Got command RPT from MCS: ref #11030
2021-04-01 03:24:50 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:24:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11030  77 59305 12290953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:24:51 [DEBUG   ] Got command RPT from MCS: ref #11032
2021-04-01 03:24:51 [DEBUG   ] summary = ERROR
2021-04-01 03:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11032  13 59305 12291145 A  ERRORERROR'
2021-04-01 03:24:51 [DEBUG   ] Got command RPT from MCS: ref #11034
2021-04-01 03:24:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11034  77 59305 12291349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:24:51 [DEBUG   ] Got command RPT from MCS: ref #11036
2021-04-01 03:24:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11036  12 59305 12291553 A  ERRORB¢ff'
2021-04-01 03:24:55 [DEBUG   ] Got command STP from MCS: ref #11037
2021-04-01 03:24:55 [INFO    ] Finished processing BAM request
2021-04-01 03:24:55 [INFO    ] Shutdown the adder chain on beam #2
2021-04-01 03:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    11037   8 59305 12295029 A  ERROR'
2021-04-01 03:24:55 [DEBUG   ] Got command STP from MCS: ref #11038
2021-04-01 03:24:55 [INFO    ] Finished processing BAM request
2021-04-01 03:24:55 [INFO    ] Shutdown the adder chain on beam #3
2021-04-01 03:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    11038   8 59305 12295033 A  ERROR'
2021-04-01 03:24:55 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 03:24:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 03:24:55 [DEBUG   ] spawn_process: at 2021-04-01 03:24:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 03:24:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:24:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 03:24:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:24:58 [DEBUG   ] Finished updating board flags in 1.181 seconds
2021-04-01 03:25:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:25:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:25:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:25:58 [DEBUG   ] Finished updating board flags in 1.018 seconds
2021-04-01 03:26:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:26:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 03:26:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:26:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:26:58 [DEBUG   ] Finished updating board flags in 1.006 seconds
2021-04-01 03:27:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:27:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:27:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:27:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:27:58 [DEBUG   ] Finished updating board flags in 1.001 seconds
2021-04-01 03:28:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:28:35 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 03:28:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:28:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:28:58 [DEBUG   ] Finished updating board flags in 0.994 seconds
2021-04-01 03:29:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:29:20 [DEBUG   ] Got command RPT from MCS: ref #11045
2021-04-01 03:29:20 [DEBUG   ] summary = ERROR
2021-04-01 03:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11045  13 59305 12560417 A  ERRORERROR'
2021-04-01 03:29:20 [DEBUG   ] Got command RPT from MCS: ref #11046
2021-04-01 03:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11046  77 59305 12560417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:29:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:29:50 [DEBUG   ] Got command RPT from MCS: ref #11064
2021-04-01 03:29:50 [DEBUG   ] summary = ERROR
2021-04-01 03:29:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11064  13 59305 12590817 A  ERRORERROR'
2021-04-01 03:29:51 [DEBUG   ] Got command RPT from MCS: ref #11065
2021-04-01 03:29:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11065  77 59305 12591021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:29:51 [DEBUG   ] Got command RPT from MCS: ref #11066
2021-04-01 03:29:51 [DEBUG   ] summary = ERROR
2021-04-01 03:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11066  13 59305 12591225 A  ERRORERROR'
2021-04-01 03:29:51 [DEBUG   ] Got command RPT from MCS: ref #11067
2021-04-01 03:29:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11067  77 59305 12591417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:29:51 [DEBUG   ] Got command RPT from MCS: ref #11069
2021-04-01 03:29:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11069  12 59305 12591621 A  ERRORB˜™š'
2021-04-01 03:29:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:29:58 [DEBUG   ] Finished updating board flags in 1.271 seconds
2021-04-01 03:30:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 03:30:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:30:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 03:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:30:58 [DEBUG   ] Finished updating board flags in 1.163 seconds
2021-04-01 03:31:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:31:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:31:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:31:58 [DEBUG   ] Finished updating board flags in 1.036 seconds
2021-04-01 03:32:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:32:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:32:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:32:59 [DEBUG   ] Finished updating board flags in 1.608 seconds
2021-04-01 03:33:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 03:33:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:33:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:33:59 [DEBUG   ] Finished updating board flags in 1.525 seconds
2021-04-01 03:34:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:34:20 [DEBUG   ] Got command RPT from MCS: ref #11086
2021-04-01 03:34:20 [DEBUG   ] summary = ERROR
2021-04-01 03:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11086  13 59305 12860421 A  ERRORERROR'
2021-04-01 03:34:20 [DEBUG   ] Got command RPT from MCS: ref #11087
2021-04-01 03:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11087  77 59305 12860421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:34:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:34:50 [DEBUG   ] Got command RPT from MCS: ref #11103
2021-04-01 03:34:50 [DEBUG   ] summary = ERROR
2021-04-01 03:34:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11103  13 59305 12890889 A  ERRORERROR'
2021-04-01 03:34:51 [DEBUG   ] Got command RPT from MCS: ref #11104
2021-04-01 03:34:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11104  77 59305 12891093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:34:51 [DEBUG   ] Got command RPT from MCS: ref #11105
2021-04-01 03:34:51 [DEBUG   ] summary = ERROR
2021-04-01 03:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11105  13 59305 12891297 A  ERRORERROR'
2021-04-01 03:34:51 [DEBUG   ] Got command RPT from MCS: ref #11106
2021-04-01 03:34:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11106  77 59305 12891501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:34:51 [DEBUG   ] Got command RPT from MCS: ref #11107
2021-04-01 03:34:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11107  12 59305 12891693 A  ERRORB—™š'
2021-04-01 03:34:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 03:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 03:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:34:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:34:59 [DEBUG   ] Finished updating board flags in 1.417 seconds
2021-04-01 03:35:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:35:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:35:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 03:35:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:35:59 [DEBUG   ] Finished updating board flags in 1.396 seconds
2021-04-01 03:36:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:36:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:36:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:36:59 [DEBUG   ] Finished updating board flags in 1.220 seconds
2021-04-01 03:37:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:37:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:37:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:37:59 [DEBUG   ] Finished updating board flags in 1.209 seconds
2021-04-01 03:38:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:38:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 03:38:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:38:59 [DEBUG   ] Finished updating board flags in 1.170 seconds
2021-04-01 03:39:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:39:20 [DEBUG   ] Got command RPT from MCS: ref #11114
2021-04-01 03:39:20 [DEBUG   ] summary = ERROR
2021-04-01 03:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11114  13 59305 13160417 A  ERRORERROR'
2021-04-01 03:39:20 [DEBUG   ] Got command RPT from MCS: ref #11115
2021-04-01 03:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11115  77 59305 13160417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:39:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:39:50 [DEBUG   ] Got command RPT from MCS: ref #11135
2021-04-01 03:39:50 [DEBUG   ] summary = ERROR
2021-04-01 03:39:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11135  13 59305 13190973 A  ERRORERROR'
2021-04-01 03:39:51 [DEBUG   ] Got command RPT from MCS: ref #11137
2021-04-01 03:39:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11137  77 59305 13191165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:39:51 [DEBUG   ] Got command RPT from MCS: ref #11139
2021-04-01 03:39:51 [DEBUG   ] summary = ERROR
2021-04-01 03:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11139  13 59305 13191369 A  ERRORERROR'
2021-04-01 03:39:51 [DEBUG   ] Got command RPT from MCS: ref #11141
2021-04-01 03:39:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11141  77 59305 13191573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:39:51 [DEBUG   ] Got command RPT from MCS: ref #11144
2021-04-01 03:39:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11144  12 59305 13191777 A  ERRORB—™š'
2021-04-01 03:39:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:39:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:39:59 [DEBUG   ] Finished updating board flags in 1.072 seconds
2021-04-01 03:40:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 03:40:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:40:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 03:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:41:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:41:00 [DEBUG   ] Finished updating board flags in 2.013 seconds
2021-04-01 03:41:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:41:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:41:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:41:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:41:59 [DEBUG   ] Finished updating board flags in 1.371 seconds
2021-04-01 03:42:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:42:37 [DEBUG   ] Finished updating ant stats in 1.146 seconds
2021-04-01 03:42:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:42:59 [DEBUG   ] Finished updating board flags in 1.216 seconds
2021-04-01 03:43:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 03:43:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:43:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:43:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:43:59 [DEBUG   ] Finished updating board flags in 1.188 seconds
2021-04-01 03:44:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:44:20 [DEBUG   ] Got command RPT from MCS: ref #11155
2021-04-01 03:44:20 [DEBUG   ] summary = ERROR
2021-04-01 03:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11155  13 59305 13460425 A  ERRORERROR'
2021-04-01 03:44:20 [DEBUG   ] Got command RPT from MCS: ref #11156
2021-04-01 03:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11156  77 59305 13460425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:44:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:44:51 [DEBUG   ] Got command RPT from MCS: ref #11172
2021-04-01 03:44:51 [DEBUG   ] summary = ERROR
2021-04-01 03:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11172  13 59305 13491037 A  ERRORERROR'
2021-04-01 03:44:51 [DEBUG   ] Got command RPT from MCS: ref #11173
2021-04-01 03:44:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11173  77 59305 13491241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:44:51 [DEBUG   ] Got command RPT from MCS: ref #11174
2021-04-01 03:44:51 [DEBUG   ] summary = ERROR
2021-04-01 03:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11174  13 59305 13491445 A  ERRORERROR'
2021-04-01 03:44:51 [DEBUG   ] Got command RPT from MCS: ref #11175
2021-04-01 03:44:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11175  77 59305 13491649 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:44:51 [DEBUG   ] Got command RPT from MCS: ref #11176
2021-04-01 03:44:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11176  12 59305 13491841 A  ERRORB–™š'
2021-04-01 03:44:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 03:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:44:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:44:59 [DEBUG   ] Finished updating board flags in 1.008 seconds
2021-04-01 03:45:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:45:38 [DEBUG   ] Finished updating ant stats in 2.002 seconds
2021-04-01 03:45:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:45:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:45:59 [DEBUG   ] Finished updating board flags in 1.044 seconds
2021-04-01 03:46:01 [DEBUG   ] Got command TBN from MCS: ref #11183
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] tbn = exited with status True, code 0x00
2021-04-01 03:46:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    11183   8 59305 13561021 A  ERROR'
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1617248762']
2021-04-01 03:46:01 [DEBUG   ] spawn_process: at 2021-04-01 03:46:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1617248762']
2021-04-01 03:46:01 [INFO    ] Finished spawning TBN in 0.049 s
2021-04-01 03:46:17 [DEBUG   ] Finished updating ant stats in 1.066 seconds
2021-04-01 03:46:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 03:46:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 03:46:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:47:00 [DEBUG   ] Finished updating board flags in 1.762 seconds
2021-04-01 03:47:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 03:47:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 03:47:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 03:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:48:00 [DEBUG   ] Finished updating board flags in 1.715 seconds
2021-04-01 03:48:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 03:48:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 03:48:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:49:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:49:00 [DEBUG   ] Finished updating board flags in 1.641 seconds
2021-04-01 03:49:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 03:49:20 [DEBUG   ] Got command RPT from MCS: ref #11190
2021-04-01 03:49:20 [DEBUG   ] summary = ERROR
2021-04-01 03:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11190  13 59305 13760429 A  ERRORERROR'
2021-04-01 03:49:20 [DEBUG   ] Got command RPT from MCS: ref #11191
2021-04-01 03:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11191  77 59305 13760429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:49:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 03:49:51 [DEBUG   ] Got command RPT from MCS: ref #11209
2021-04-01 03:49:51 [DEBUG   ] summary = ERROR
2021-04-01 03:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11209  13 59305 13791121 A  ERRORERROR'
2021-04-01 03:49:51 [DEBUG   ] Got command RPT from MCS: ref #11210
2021-04-01 03:49:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11210  77 59305 13791313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:49:51 [DEBUG   ] Got command RPT from MCS: ref #11211
2021-04-01 03:49:51 [DEBUG   ] summary = ERROR
2021-04-01 03:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11211  13 59305 13791517 A  ERRORERROR'
2021-04-01 03:49:51 [DEBUG   ] Got command RPT from MCS: ref #11212
2021-04-01 03:49:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11212  77 59305 13791721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:49:51 [DEBUG   ] Got command RPT from MCS: ref #11214
2021-04-01 03:49:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11214  12 59305 13791913 A  ERRORB—™š'
2021-04-01 03:49:57 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2021-04-01 03:49:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:50:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:50:00 [DEBUG   ] Finished updating board flags in 1.635 seconds
2021-04-01 03:50:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:50:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 03:50:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 03:51:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:51:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:51:00 [DEBUG   ] Finished updating board flags in 1.635 seconds
2021-04-01 03:51:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 03:51:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:51:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:52:00 [DEBUG   ] Finished updating board flags in 1.627 seconds
2021-04-01 03:52:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 03:52:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 03:52:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:53:00 [DEBUG   ] Finished updating board flags in 1.635 seconds
2021-04-01 03:53:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:53:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 03:53:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 03:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:54:00 [DEBUG   ] Finished updating board flags in 1.643 seconds
2021-04-01 03:54:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:54:20 [DEBUG   ] Got command RPT from MCS: ref #11235
2021-04-01 03:54:20 [DEBUG   ] summary = ERROR
2021-04-01 03:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11235  13 59305 14060425 A  ERRORERROR'
2021-04-01 03:54:20 [DEBUG   ] Got command RPT from MCS: ref #11236
2021-04-01 03:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11236  77 59305 14060425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:54:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:54:51 [DEBUG   ] Got command RPT from MCS: ref #11254
2021-04-01 03:54:51 [DEBUG   ] summary = ERROR
2021-04-01 03:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11254  13 59305 14091185 A  ERRORERROR'
2021-04-01 03:54:51 [DEBUG   ] Got command RPT from MCS: ref #11256
2021-04-01 03:54:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11256  77 59305 14091389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:54:51 [DEBUG   ] Got command RPT from MCS: ref #11258
2021-04-01 03:54:51 [DEBUG   ] summary = ERROR
2021-04-01 03:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11258  13 59305 14091593 A  ERRORERROR'
2021-04-01 03:54:51 [DEBUG   ] Got command RPT from MCS: ref #11260
2021-04-01 03:54:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11260  77 59305 14091785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:54:51 [DEBUG   ] Got command RPT from MCS: ref #11262
2021-04-01 03:54:51 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:54:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11262  12 59305 14091989 A  ERRORB—™š'
2021-04-01 03:54:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 03:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:55:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:55:01 [DEBUG   ] Finished updating board flags in 1.644 seconds
2021-04-01 03:55:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 03:55:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:55:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 03:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:56:01 [DEBUG   ] Finished updating board flags in 1.651 seconds
2021-04-01 03:56:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-04-01 03:56:37 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-04-01 03:56:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 03:57:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:57:01 [DEBUG   ] Finished updating board flags in 2.312 seconds
2021-04-01 03:57:18 [DEBUG   ] Finished updating ant stats in 1.184 seconds
2021-04-01 03:57:38 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-04-01 03:57:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 03:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:58:01 [DEBUG   ] Finished updating board flags in 2.051 seconds
2021-04-01 03:58:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 03:58:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 03:58:58 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2021-04-01 03:59:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 03:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 03:59:01 [DEBUG   ] Finished updating board flags in 2.023 seconds
2021-04-01 03:59:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:59:20 [DEBUG   ] Got command RPT from MCS: ref #11269
2021-04-01 03:59:20 [DEBUG   ] summary = ERROR
2021-04-01 03:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11269  13 59305 14360425 A  ERRORERROR'
2021-04-01 03:59:20 [DEBUG   ] Got command RPT from MCS: ref #11270
2021-04-01 03:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11270  77 59305 14360425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:59:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 03:59:51 [DEBUG   ] Got command RPT from MCS: ref #11288
2021-04-01 03:59:51 [DEBUG   ] summary = ERROR
2021-04-01 03:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11288  13 59305 14391257 A  ERRORERROR'
2021-04-01 03:59:51 [DEBUG   ] Got command RPT from MCS: ref #11289
2021-04-01 03:59:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11289  77 59305 14391461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:59:51 [DEBUG   ] Got command RPT from MCS: ref #11290
2021-04-01 03:59:51 [DEBUG   ] summary = ERROR
2021-04-01 03:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11290  13 59305 14391665 A  ERRORERROR'
2021-04-01 03:59:51 [DEBUG   ] Got command RPT from MCS: ref #11291
2021-04-01 03:59:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 03:59:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11291  77 59305 14391857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 03:59:52 [DEBUG   ] Got command RPT from MCS: ref #11293
2021-04-01 03:59:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 03:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11293  12 59305 14392061 A  ERRORB˜™š'
2021-04-01 03:59:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 04:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:00:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:00:01 [DEBUG   ] Finished updating board flags in 1.991 seconds
2021-04-01 04:00:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:00:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:00:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:01:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:01:01 [DEBUG   ] Finished updating board flags in 1.802 seconds
2021-04-01 04:01:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 04:01:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:01:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:02:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:02:01 [DEBUG   ] Finished updating board flags in 1.808 seconds
2021-04-01 04:02:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:02:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 04:02:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:03:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:03:01 [DEBUG   ] Finished updating board flags in 1.892 seconds
2021-04-01 04:03:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:03:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:03:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 04:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:04:01 [DEBUG   ] Finished updating board flags in 1.722 seconds
2021-04-01 04:04:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:04:20 [DEBUG   ] Got command RPT from MCS: ref #11310
2021-04-01 04:04:20 [DEBUG   ] summary = ERROR
2021-04-01 04:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11310  13 59305 14660429 A  ERRORERROR'
2021-04-01 04:04:20 [DEBUG   ] Got command RPT from MCS: ref #11311
2021-04-01 04:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11311  77 59305 14660429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:04:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:04:51 [DEBUG   ] Got command RPT from MCS: ref #11327
2021-04-01 04:04:51 [DEBUG   ] summary = ERROR
2021-04-01 04:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11327  13 59305 14691329 A  ERRORERROR'
2021-04-01 04:04:51 [DEBUG   ] Got command RPT from MCS: ref #11328
2021-04-01 04:04:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11328  77 59305 14691533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:04:51 [DEBUG   ] Got command RPT from MCS: ref #11329
2021-04-01 04:04:51 [DEBUG   ] summary = ERROR
2021-04-01 04:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11329  13 59305 14691737 A  ERRORERROR'
2021-04-01 04:04:51 [DEBUG   ] Got command RPT from MCS: ref #11330
2021-04-01 04:04:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:04:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11330  77 59305 14691929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:04:52 [DEBUG   ] Got command RPT from MCS: ref #11331
2021-04-01 04:04:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11331  12 59305 14692133 A  ERRORB–™š'
2021-04-01 04:04:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:05:01 [DEBUG   ] Finished updating board flags in 1.621 seconds
2021-04-01 04:05:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 04:05:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 04:05:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-04-01 04:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:06:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:06:01 [DEBUG   ] Finished updating board flags in 1.567 seconds
2021-04-01 04:06:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 04:06:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 04:06:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 04:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:07:01 [DEBUG   ] Finished updating board flags in 1.425 seconds
2021-04-01 04:07:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 04:07:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 04:07:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 04:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:08:01 [DEBUG   ] Finished updating board flags in 1.366 seconds
2021-04-01 04:08:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 04:08:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 04:08:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 04:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:09:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:09:01 [DEBUG   ] Finished updating board flags in 1.444 seconds
2021-04-01 04:09:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 04:09:20 [DEBUG   ] Got command RPT from MCS: ref #11338
2021-04-01 04:09:20 [DEBUG   ] summary = ERROR
2021-04-01 04:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11338  13 59305 14960429 A  ERRORERROR'
2021-04-01 04:09:20 [DEBUG   ] Got command RPT from MCS: ref #11339
2021-04-01 04:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11339  77 59305 14960429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:09:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 04:09:51 [DEBUG   ] Got command RPT from MCS: ref #11359
2021-04-01 04:09:51 [DEBUG   ] summary = ERROR
2021-04-01 04:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11359  13 59305 14991401 A  ERRORERROR'
2021-04-01 04:09:51 [DEBUG   ] Got command RPT from MCS: ref #11361
2021-04-01 04:09:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11361  77 59305 14991605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:09:51 [DEBUG   ] Got command RPT from MCS: ref #11363
2021-04-01 04:09:51 [DEBUG   ] summary = ERROR
2021-04-01 04:09:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11363  13 59305 14991809 A  ERRORERROR'
2021-04-01 04:09:52 [DEBUG   ] Got command RPT from MCS: ref #11365
2021-04-01 04:09:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11365  77 59305 14992013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:09:52 [DEBUG   ] Got command RPT from MCS: ref #11368
2021-04-01 04:09:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11368  12 59305 14992205 A  ERRORB—™š'
2021-04-01 04:09:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 04:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:10:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:10:02 [DEBUG   ] Finished updating board flags in 2.207 seconds
2021-04-01 04:10:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 04:10:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:10:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 04:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:11:02 [DEBUG   ] Finished updating board flags in 2.177 seconds
2021-04-01 04:11:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 04:11:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 04:11:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:12:02 [DEBUG   ] Finished updating board flags in 2.007 seconds
2021-04-01 04:12:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:12:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-04-01 04:13:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-04-01 04:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:13:02 [DEBUG   ] Finished updating board flags in 1.979 seconds
2021-04-01 04:13:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-04-01 04:13:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 04:14:00 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 04:14:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:14:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:14:02 [DEBUG   ] Finished updating board flags in 1.804 seconds
2021-04-01 04:14:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 04:14:20 [DEBUG   ] Got command RPT from MCS: ref #11379
2021-04-01 04:14:20 [DEBUG   ] summary = ERROR
2021-04-01 04:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11379  13 59305 15260429 A  ERRORERROR'
2021-04-01 04:14:20 [DEBUG   ] Got command RPT from MCS: ref #11380
2021-04-01 04:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11380  77 59305 15260429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:14:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 04:14:51 [DEBUG   ] Got command RPT from MCS: ref #11396
2021-04-01 04:14:51 [DEBUG   ] summary = ERROR
2021-04-01 04:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11396  13 59305 15291473 A  ERRORERROR'
2021-04-01 04:14:51 [DEBUG   ] Got command RPT from MCS: ref #11397
2021-04-01 04:14:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11397  77 59305 15291677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:14:51 [DEBUG   ] Got command RPT from MCS: ref #11398
2021-04-01 04:14:51 [DEBUG   ] summary = ERROR
2021-04-01 04:14:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11398  13 59305 15291881 A  ERRORERROR'
2021-04-01 04:14:52 [DEBUG   ] Got command RPT from MCS: ref #11399
2021-04-01 04:14:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11399  77 59305 15292073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:14:52 [DEBUG   ] Got command RPT from MCS: ref #11400
2021-04-01 04:14:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11400  12 59305 15292277 A  ERRORB—™š'
2021-04-01 04:15:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 04:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:15:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:15:02 [DEBUG   ] Finished updating board flags in 1.816 seconds
2021-04-01 04:15:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:15:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:16:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2021-04-01 04:16:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:16:02 [DEBUG   ] Finished updating board flags in 1.882 seconds
2021-04-01 04:16:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 04:16:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:17:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:17:02 [DEBUG   ] Finished updating board flags in 1.952 seconds
2021-04-01 04:17:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:17:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 04:18:00 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 04:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:18:02 [DEBUG   ] Finished updating board flags in 1.573 seconds
2021-04-01 04:18:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:18:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:19:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:19:02 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-04-01 04:19:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:19:20 [DEBUG   ] Got command RPT from MCS: ref #11413
2021-04-01 04:19:20 [DEBUG   ] summary = ERROR
2021-04-01 04:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11413  13 59305 15560433 A  ERRORERROR'
2021-04-01 04:19:20 [DEBUG   ] Got command RPT from MCS: ref #11414
2021-04-01 04:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11414  77 59305 15560433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:19:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:19:51 [DEBUG   ] Got command RPT from MCS: ref #11432
2021-04-01 04:19:51 [DEBUG   ] summary = ERROR
2021-04-01 04:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11432  13 59305 15591545 A  ERRORERROR'
2021-04-01 04:19:51 [DEBUG   ] Got command RPT from MCS: ref #11433
2021-04-01 04:19:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11433  77 59305 15591749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:19:51 [DEBUG   ] Got command RPT from MCS: ref #11434
2021-04-01 04:19:51 [DEBUG   ] summary = ERROR
2021-04-01 04:19:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11434  13 59305 15591953 A  ERRORERROR'
2021-04-01 04:19:52 [DEBUG   ] Got command RPT from MCS: ref #11435
2021-04-01 04:19:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11435  77 59305 15592157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:19:52 [DEBUG   ] Got command RPT from MCS: ref #11437
2021-04-01 04:19:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11437  12 59305 15592349 A  ERRORB—™š'
2021-04-01 04:20:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:20:02 [DEBUG   ] Finished updating board flags in 1.469 seconds
2021-04-01 04:20:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:20:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:21:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:21:02 [DEBUG   ] Finished updating board flags in 1.492 seconds
2021-04-01 04:21:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:21:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:22:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:22:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:22:03 [DEBUG   ] Finished updating board flags in 1.585 seconds
2021-04-01 04:22:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:22:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:23:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:23:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:23:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:23:03 [DEBUG   ] Finished updating board flags in 2.160 seconds
2021-04-01 04:23:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:23:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:24:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:24:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:24:03 [DEBUG   ] Finished updating board flags in 1.874 seconds
2021-04-01 04:24:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 04:24:20 [DEBUG   ] Got command RPT from MCS: ref #11448
2021-04-01 04:24:20 [DEBUG   ] summary = ERROR
2021-04-01 04:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11448  13 59305 15860437 A  ERRORERROR'
2021-04-01 04:24:20 [DEBUG   ] Got command RPT from MCS: ref #11449
2021-04-01 04:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11449  77 59305 15860437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:24:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 04:24:51 [DEBUG   ] Got command RPT from MCS: ref #11467
2021-04-01 04:24:51 [DEBUG   ] summary = ERROR
2021-04-01 04:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11467  13 59305 15891625 A  ERRORERROR'
2021-04-01 04:24:51 [DEBUG   ] Got command RPT from MCS: ref #11469
2021-04-01 04:24:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:24:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11469  77 59305 15891817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:24:52 [DEBUG   ] Got command RPT from MCS: ref #11471
2021-04-01 04:24:52 [DEBUG   ] summary = ERROR
2021-04-01 04:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11471  13 59305 15892021 A  ERRORERROR'
2021-04-01 04:24:52 [DEBUG   ] Got command RPT from MCS: ref #11473
2021-04-01 04:24:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11473  77 59305 15892225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:24:52 [DEBUG   ] Got command RPT from MCS: ref #11475
2021-04-01 04:24:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11475  12 59305 15892429 A  ERRORB˜™š'
2021-04-01 04:25:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 04:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:25:03 [DEBUG   ] Finished updating board flags in 1.822 seconds
2021-04-01 04:25:21 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2021-04-01 04:25:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 04:26:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 04:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:26:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:26:03 [DEBUG   ] Finished updating board flags in 1.772 seconds
2021-04-01 04:26:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 04:26:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 04:27:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-04-01 04:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:27:03 [DEBUG   ] Finished updating board flags in 1.612 seconds
2021-04-01 04:27:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 04:27:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 04:28:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2021-04-01 04:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:28:03 [DEBUG   ] Finished updating board flags in 1.591 seconds
2021-04-01 04:28:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 04:28:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:29:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 04:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:29:03 [DEBUG   ] Finished updating board flags in 1.423 seconds
2021-04-01 04:29:20 [DEBUG   ] Got command RPT from MCS: ref #11482
2021-04-01 04:29:20 [DEBUG   ] summary = ERROR
2021-04-01 04:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11482  13 59305 16160437 A  ERRORERROR'
2021-04-01 04:29:20 [DEBUG   ] Got command RPT from MCS: ref #11483
2021-04-01 04:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11483  77 59305 16160437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:29:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-04-01 04:29:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:29:51 [DEBUG   ] Got command RPT from MCS: ref #11501
2021-04-01 04:29:51 [DEBUG   ] summary = ERROR
2021-04-01 04:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11501  13 59305 16191697 A  ERRORERROR'
2021-04-01 04:29:51 [DEBUG   ] Got command RPT from MCS: ref #11502
2021-04-01 04:29:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11502  77 59305 16191889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:29:52 [DEBUG   ] Got command RPT from MCS: ref #11503
2021-04-01 04:29:52 [DEBUG   ] summary = ERROR
2021-04-01 04:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11503  13 59305 16192093 A  ERRORERROR'
2021-04-01 04:29:52 [DEBUG   ] Got command RPT from MCS: ref #11504
2021-04-01 04:29:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11504  77 59305 16192297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:29:52 [DEBUG   ] Got command RPT from MCS: ref #11506
2021-04-01 04:29:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11506  12 59305 16192489 A  ERRORB—™š'
2021-04-01 04:30:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:30:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 04:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:30:03 [DEBUG   ] Finished updating board flags in 1.393 seconds
2021-04-01 04:30:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:30:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 04:31:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:31:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:31:03 [DEBUG   ] Finished updating board flags in 1.352 seconds
2021-04-01 04:31:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:31:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:32:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 04:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:32:04 [DEBUG   ] Finished updating board flags in 2.068 seconds
2021-04-01 04:32:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 04:32:42 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-04-01 04:33:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2021-04-01 04:33:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:33:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:33:04 [DEBUG   ] Finished updating board flags in 1.976 seconds
2021-04-01 04:33:21 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2021-04-01 04:33:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 04:34:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 04:34:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:34:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:34:04 [DEBUG   ] Finished updating board flags in 1.826 seconds
2021-04-01 04:34:20 [DEBUG   ] Got command RPT from MCS: ref #11523
2021-04-01 04:34:20 [DEBUG   ] summary = ERROR
2021-04-01 04:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11523  13 59305 16460433 A  ERRORERROR'
2021-04-01 04:34:20 [DEBUG   ] Got command RPT from MCS: ref #11524
2021-04-01 04:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11524  77 59305 16460433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:34:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-04-01 04:34:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 04:34:51 [DEBUG   ] Got command RPT from MCS: ref #11540
2021-04-01 04:34:51 [DEBUG   ] summary = ERROR
2021-04-01 04:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11540  13 59305 16491765 A  ERRORERROR'
2021-04-01 04:34:51 [DEBUG   ] Got command RPT from MCS: ref #11541
2021-04-01 04:34:51 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:34:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11541  77 59305 16491969 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:34:52 [DEBUG   ] Got command RPT from MCS: ref #11542
2021-04-01 04:34:52 [DEBUG   ] summary = ERROR
2021-04-01 04:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11542  13 59305 16492161 A  ERRORERROR'
2021-04-01 04:34:52 [DEBUG   ] Got command RPT from MCS: ref #11543
2021-04-01 04:34:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11543  77 59305 16492365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:34:52 [DEBUG   ] Got command RPT from MCS: ref #11544
2021-04-01 04:34:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11544  12 59305 16492569 A  ERRORB—™š'
2021-04-01 04:35:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:35:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:35:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:35:04 [DEBUG   ] Finished updating board flags in 1.779 seconds
2021-04-01 04:35:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 04:35:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 04:36:02 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2021-04-01 04:36:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:36:04 [DEBUG   ] Finished updating board flags in 1.618 seconds
2021-04-01 04:36:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 04:36:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 04:37:03 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2021-04-01 04:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:37:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:37:04 [DEBUG   ] Finished updating board flags in 1.588 seconds
2021-04-01 04:37:23 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2021-04-01 04:37:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 04:38:03 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2021-04-01 04:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:38:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:38:04 [DEBUG   ] Finished updating board flags in 1.418 seconds
2021-04-01 04:38:23 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2021-04-01 04:38:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:39:03 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2021-04-01 04:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:39:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:39:04 [DEBUG   ] Finished updating board flags in 1.385 seconds
2021-04-01 04:39:20 [DEBUG   ] Got command RPT from MCS: ref #11551
2021-04-01 04:39:20 [DEBUG   ] summary = ERROR
2021-04-01 04:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11551  13 59305 16760437 A  ERRORERROR'
2021-04-01 04:39:20 [DEBUG   ] Got command RPT from MCS: ref #11552
2021-04-01 04:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11552  77 59305 16760437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:39:23 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2021-04-01 04:39:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:39:51 [DEBUG   ] Got command RPT from MCS: ref #11572
2021-04-01 04:39:51 [DEBUG   ] summary = ERROR
2021-04-01 04:39:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11572  13 59305 16791837 A  ERRORERROR'
2021-04-01 04:39:52 [DEBUG   ] Got command RPT from MCS: ref #11574
2021-04-01 04:39:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11574  77 59305 16792041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:39:52 [DEBUG   ] Got command RPT from MCS: ref #11576
2021-04-01 04:39:52 [DEBUG   ] summary = ERROR
2021-04-01 04:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11576  13 59305 16792245 A  ERRORERROR'
2021-04-01 04:39:52 [DEBUG   ] Got command RPT from MCS: ref #11578
2021-04-01 04:39:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11578  77 59305 16792437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:39:52 [DEBUG   ] Got command RPT from MCS: ref #11581
2021-04-01 04:39:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11581  12 59305 16792641 A  ERRORB—™š'
2021-04-01 04:40:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:40:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:40:04 [DEBUG   ] Finished updating board flags in 1.354 seconds
2021-04-01 04:40:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:40:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:41:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:41:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:41:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:41:05 [DEBUG   ] Finished updating board flags in 2.062 seconds
2021-04-01 04:41:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:41:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:42:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:42:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:42:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:42:05 [DEBUG   ] Finished updating board flags in 2.100 seconds
2021-04-01 04:42:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 04:42:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:43:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:43:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:43:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:43:05 [DEBUG   ] Finished updating board flags in 1.899 seconds
2021-04-01 04:43:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:43:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:44:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:44:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:44:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:44:05 [DEBUG   ] Finished updating board flags in 1.818 seconds
2021-04-01 04:44:20 [DEBUG   ] Got command RPT from MCS: ref #11592
2021-04-01 04:44:20 [DEBUG   ] summary = ERROR
2021-04-01 04:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11592  13 59305 17060433 A  ERRORERROR'
2021-04-01 04:44:20 [DEBUG   ] Got command RPT from MCS: ref #11593
2021-04-01 04:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11593  77 59305 17060433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:44:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 04:44:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 04:44:51 [DEBUG   ] Got command RPT from MCS: ref #11609
2021-04-01 04:44:51 [DEBUG   ] summary = ERROR
2021-04-01 04:44:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11609  13 59305 17091913 A  ERRORERROR'
2021-04-01 04:44:52 [DEBUG   ] Got command RPT from MCS: ref #11610
2021-04-01 04:44:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11610  77 59305 17092117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:44:52 [DEBUG   ] Got command RPT from MCS: ref #11611
2021-04-01 04:44:52 [DEBUG   ] summary = ERROR
2021-04-01 04:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11611  13 59305 17092321 A  ERRORERROR'
2021-04-01 04:44:52 [DEBUG   ] Got command RPT from MCS: ref #11612
2021-04-01 04:44:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11612  77 59305 17092513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:44:52 [DEBUG   ] Got command RPT from MCS: ref #11613
2021-04-01 04:44:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11613  12 59305 17092717 A  ERRORB˜™š'
2021-04-01 04:45:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 04:45:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:45:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:45:05 [DEBUG   ] Finished updating board flags in 1.813 seconds
2021-04-01 04:45:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 04:45:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 04:46:04 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2021-04-01 04:46:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:46:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:46:05 [DEBUG   ] Finished updating board flags in 1.764 seconds
2021-04-01 04:46:24 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2021-04-01 04:46:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 04:47:04 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2021-04-01 04:47:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:47:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:47:05 [DEBUG   ] Finished updating board flags in 1.608 seconds
2021-04-01 04:47:24 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2021-04-01 04:47:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 04:48:04 [DEBUG   ] Finished updating ant stats in 0.851 seconds
2021-04-01 04:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:48:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:48:05 [DEBUG   ] Finished updating board flags in 1.584 seconds
2021-04-01 04:48:24 [DEBUG   ] Finished updating ant stats in 0.754 seconds
2021-04-01 04:48:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 04:49:04 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2021-04-01 04:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:49:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:49:05 [DEBUG   ] Finished updating board flags in 1.414 seconds
2021-04-01 04:49:20 [DEBUG   ] Got command RPT from MCS: ref #11626
2021-04-01 04:49:20 [DEBUG   ] summary = ERROR
2021-04-01 04:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11626  13 59305 17360433 A  ERRORERROR'
2021-04-01 04:49:20 [DEBUG   ] Got command RPT from MCS: ref #11627
2021-04-01 04:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11627  77 59305 17360433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:49:24 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2021-04-01 04:49:45 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-04-01 04:49:51 [DEBUG   ] Got command RPT from MCS: ref #11645
2021-04-01 04:49:51 [DEBUG   ] summary = ERROR
2021-04-01 04:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11645  13 59305 17391985 A  ERRORERROR'
2021-04-01 04:49:52 [DEBUG   ] Got command RPT from MCS: ref #11646
2021-04-01 04:49:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11646  77 59305 17392189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:49:52 [DEBUG   ] Got command RPT from MCS: ref #11647
2021-04-01 04:49:52 [DEBUG   ] summary = ERROR
2021-04-01 04:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11647  13 59305 17392393 A  ERRORERROR'
2021-04-01 04:49:52 [DEBUG   ] Got command RPT from MCS: ref #11648
2021-04-01 04:49:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11648  77 59305 17392585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:49:52 [DEBUG   ] Got command RPT from MCS: ref #11650
2021-04-01 04:49:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11650  12 59305 17392789 A  ERRORB—™š'
2021-04-01 04:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:50:05 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2021-04-01 04:50:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:50:05 [DEBUG   ] Finished updating board flags in 1.467 seconds
2021-04-01 04:50:25 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2021-04-01 04:50:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 04:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:51:05 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2021-04-01 04:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:51:05 [DEBUG   ] Finished updating board flags in 1.461 seconds
2021-04-01 04:51:25 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2021-04-01 04:51:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:52:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:52:05 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2021-04-01 04:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:52:05 [DEBUG   ] Finished updating board flags in 1.432 seconds
2021-04-01 04:52:25 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2021-04-01 04:52:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 04:53:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:53:05 [DEBUG   ] Finished updating board flags in 1.425 seconds
2021-04-01 04:53:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-04-01 04:53:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 04:53:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 04:54:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:54:05 [DEBUG   ] Finished updating board flags in 1.412 seconds
2021-04-01 04:54:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 04:54:20 [DEBUG   ] Got command RPT from MCS: ref #11661
2021-04-01 04:54:20 [DEBUG   ] summary = ERROR
2021-04-01 04:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11661  13 59305 17660437 A  ERRORERROR'
2021-04-01 04:54:20 [DEBUG   ] Got command RPT from MCS: ref #11662
2021-04-01 04:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11662  77 59305 17660437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:54:26 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-04-01 04:54:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 04:54:52 [DEBUG   ] Got command RPT from MCS: ref #11680
2021-04-01 04:54:52 [DEBUG   ] summary = ERROR
2021-04-01 04:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11680  13 59305 17692057 A  ERRORERROR'
2021-04-01 04:54:52 [DEBUG   ] Got command RPT from MCS: ref #11682
2021-04-01 04:54:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11682  77 59305 17692261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:54:52 [DEBUG   ] Got command RPT from MCS: ref #11684
2021-04-01 04:54:52 [DEBUG   ] summary = ERROR
2021-04-01 04:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11684  13 59305 17692453 A  ERRORERROR'
2021-04-01 04:54:52 [DEBUG   ] Got command RPT from MCS: ref #11686
2021-04-01 04:54:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11686  77 59305 17692657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:54:52 [DEBUG   ] Got command RPT from MCS: ref #11688
2021-04-01 04:54:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11688  12 59305 17692861 A  ERRORB˜™š'
2021-04-01 04:55:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:55:05 [DEBUG   ] Finished updating board flags in 1.422 seconds
2021-04-01 04:55:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 04:55:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 04:55:46 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-04-01 04:56:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:56:06 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2021-04-01 04:56:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:56:06 [DEBUG   ] Finished updating board flags in 2.257 seconds
2021-04-01 04:56:26 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2021-04-01 04:56:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 04:57:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:57:06 [DEBUG   ] Finished updating ant stats in 0.638 seconds
2021-04-01 04:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:57:06 [DEBUG   ] Finished updating board flags in 2.206 seconds
2021-04-01 04:57:26 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2021-04-01 04:57:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 04:58:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:58:06 [DEBUG   ] Finished updating board flags in 2.181 seconds
2021-04-01 04:58:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-04-01 04:58:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 04:58:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 04:59:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 04:59:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 04:59:06 [DEBUG   ] Finished updating board flags in 2.017 seconds
2021-04-01 04:59:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 04:59:20 [DEBUG   ] Got command RPT from MCS: ref #11695
2021-04-01 04:59:20 [DEBUG   ] summary = ERROR
2021-04-01 04:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11695  13 59305 17960437 A  ERRORERROR'
2021-04-01 04:59:20 [DEBUG   ] Got command RPT from MCS: ref #11696
2021-04-01 04:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11696  77 59305 17960437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:59:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 04:59:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 04:59:52 [DEBUG   ] Got command RPT from MCS: ref #11714
2021-04-01 04:59:52 [DEBUG   ] summary = ERROR
2021-04-01 04:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11714  13 59305 17992133 A  ERRORERROR'
2021-04-01 04:59:52 [DEBUG   ] Got command RPT from MCS: ref #11715
2021-04-01 04:59:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11715  77 59305 17992329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:59:52 [DEBUG   ] Got command RPT from MCS: ref #11716
2021-04-01 04:59:52 [DEBUG   ] summary = ERROR
2021-04-01 04:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11716  13 59305 17992533 A  ERRORERROR'
2021-04-01 04:59:52 [DEBUG   ] Got command RPT from MCS: ref #11717
2021-04-01 04:59:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 04:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11717  77 59305 17992737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 04:59:52 [DEBUG   ] Got command RPT from MCS: ref #11719
2021-04-01 04:59:52 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 04:59:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11719  12 59305 17992929 A  ERRORB—™š'
2021-04-01 05:00:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:00:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:00:06 [DEBUG   ] Finished updating board flags in 2.048 seconds
2021-04-01 05:00:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 05:00:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:00:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:01:06 [DEBUG   ] Finished updating board flags in 1.940 seconds
2021-04-01 05:01:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:01:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 05:01:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:02:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:02:06 [DEBUG   ] Finished updating board flags in 1.826 seconds
2021-04-01 05:02:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:02:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:02:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 05:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:03:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 05:03:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:03:07 [DEBUG   ] Finished updating board flags in 2.920 seconds
2021-04-01 05:03:27 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2021-04-01 05:03:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:04:06 [DEBUG   ] Finished updating board flags in 1.650 seconds
2021-04-01 05:04:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:04:20 [DEBUG   ] Got command RPT from MCS: ref #11736
2021-04-01 05:04:20 [DEBUG   ] summary = ERROR
2021-04-01 05:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11736  13 59305 18260437 A  ERRORERROR'
2021-04-01 05:04:20 [DEBUG   ] Got command RPT from MCS: ref #11737
2021-04-01 05:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11737  77 59305 18260437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:04:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:04:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:04:52 [DEBUG   ] Got command RPT from MCS: ref #11753
2021-04-01 05:04:52 [DEBUG   ] summary = ERROR
2021-04-01 05:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11753  13 59305 18292201 A  ERRORERROR'
2021-04-01 05:04:52 [DEBUG   ] Got command RPT from MCS: ref #11754
2021-04-01 05:04:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11754  77 59305 18292405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:04:52 [DEBUG   ] Got command RPT from MCS: ref #11755
2021-04-01 05:04:52 [DEBUG   ] summary = ERROR
2021-04-01 05:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11755  13 59305 18292609 A  ERRORERROR'
2021-04-01 05:04:52 [DEBUG   ] Got command RPT from MCS: ref #11756
2021-04-01 05:04:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11756  77 59305 18292801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:04:53 [DEBUG   ] Got command RPT from MCS: ref #11757
2021-04-01 05:04:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11757  12 59305 18293005 A  ERRORB™™š'
2021-04-01 05:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:05:06 [DEBUG   ] Finished updating board flags in 1.642 seconds
2021-04-01 05:05:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:05:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 05:05:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:06:06 [DEBUG   ] Finished updating board flags in 1.573 seconds
2021-04-01 05:06:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:06:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:06:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 05:07:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:07:06 [DEBUG   ] Finished updating board flags in 1.543 seconds
2021-04-01 05:07:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:07:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:07:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:08:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:08:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:08:07 [DEBUG   ] Finished updating board flags in 1.603 seconds
2021-04-01 05:08:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 05:08:27 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-04-01 05:08:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 05:09:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:09:06 [DEBUG   ] Finished updating board flags in 1.353 seconds
2021-04-01 05:09:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 05:09:20 [DEBUG   ] Got command RPT from MCS: ref #11764
2021-04-01 05:09:20 [DEBUG   ] summary = ERROR
2021-04-01 05:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11764  13 59305 18560437 A  ERRORERROR'
2021-04-01 05:09:20 [DEBUG   ] Got command RPT from MCS: ref #11765
2021-04-01 05:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11765  77 59305 18560437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:09:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 05:09:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 05:09:52 [DEBUG   ] Got command RPT from MCS: ref #11785
2021-04-01 05:09:52 [DEBUG   ] summary = ERROR
2021-04-01 05:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11785  13 59305 18592281 A  ERRORERROR'
2021-04-01 05:09:52 [DEBUG   ] Got command RPT from MCS: ref #11787
2021-04-01 05:09:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11787  77 59305 18592473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:09:52 [DEBUG   ] Got command RPT from MCS: ref #11789
2021-04-01 05:09:52 [DEBUG   ] summary = ERROR
2021-04-01 05:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11789  13 59305 18592677 A  ERRORERROR'
2021-04-01 05:09:52 [DEBUG   ] Got command RPT from MCS: ref #11791
2021-04-01 05:09:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11791  77 59305 18592881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:09:53 [DEBUG   ] Got command RPT from MCS: ref #11794
2021-04-01 05:09:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11794  12 59305 18593073 A  ERRORB™™š'
2021-04-01 05:10:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:10:07 [DEBUG   ] Finished updating ant stats in 0.854 seconds
2021-04-01 05:10:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:10:07 [DEBUG   ] Finished updating board flags in 2.179 seconds
2021-04-01 05:10:27 [DEBUG   ] Finished updating ant stats in 0.746 seconds
2021-04-01 05:10:48 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2021-04-01 05:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:11:07 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2021-04-01 05:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:11:07 [DEBUG   ] Finished updating board flags in 1.935 seconds
2021-04-01 05:11:27 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2021-04-01 05:11:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 05:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:12:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:12:07 [DEBUG   ] Finished updating board flags in 1.806 seconds
2021-04-01 05:12:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 05:12:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:12:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:13:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:13:07 [DEBUG   ] Finished updating board flags in 1.769 seconds
2021-04-01 05:13:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 05:13:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:13:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:14:07 [DEBUG   ] Finished updating board flags in 1.657 seconds
2021-04-01 05:14:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:14:20 [DEBUG   ] Got command RPT from MCS: ref #11805
2021-04-01 05:14:20 [DEBUG   ] summary = ERROR
2021-04-01 05:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11805  13 59305 18860437 A  ERRORERROR'
2021-04-01 05:14:20 [DEBUG   ] Got command RPT from MCS: ref #11806
2021-04-01 05:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11806  77 59305 18860437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:14:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:14:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:14:52 [DEBUG   ] Got command RPT from MCS: ref #11822
2021-04-01 05:14:52 [DEBUG   ] summary = ERROR
2021-04-01 05:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11822  13 59305 18892353 A  ERRORERROR'
2021-04-01 05:14:52 [DEBUG   ] Got command RPT from MCS: ref #11823
2021-04-01 05:14:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11823  77 59305 18892557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:14:52 [DEBUG   ] Got command RPT from MCS: ref #11824
2021-04-01 05:14:52 [DEBUG   ] summary = ERROR
2021-04-01 05:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11824  13 59305 18892755 A  ERRORERROR'
2021-04-01 05:14:52 [DEBUG   ] Got command RPT from MCS: ref #11825
2021-04-01 05:14:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:14:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11825  77 59305 18892957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:14:53 [DEBUG   ] Got command RPT from MCS: ref #11826
2021-04-01 05:14:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11826  12 59305 18893149 A  ERRORB™™š'
2021-04-01 05:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:15:07 [DEBUG   ] Finished updating board flags in 1.605 seconds
2021-04-01 05:15:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:15:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:15:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:16:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:16:07 [DEBUG   ] Finished updating board flags in 1.666 seconds
2021-04-01 05:16:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:16:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 05:16:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 05:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:17:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:17:07 [DEBUG   ] Finished updating board flags in 1.540 seconds
2021-04-01 05:17:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 05:17:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 05:17:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 05:18:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 05:18:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:18:08 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2021-04-01 05:18:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:18:08 [DEBUG   ] Finished updating board flags in 2.402 seconds
2021-04-01 05:18:28 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2021-04-01 05:18:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:19:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:19:07 [DEBUG   ] Finished updating board flags in 1.323 seconds
2021-04-01 05:19:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:19:20 [DEBUG   ] Got command RPT from MCS: ref #11839
2021-04-01 05:19:20 [DEBUG   ] summary = ERROR
2021-04-01 05:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11839  13 59305 19160445 A  ERRORERROR'
2021-04-01 05:19:20 [DEBUG   ] Got command RPT from MCS: ref #11840
2021-04-01 05:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11840  77 59305 19160445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:19:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 05:19:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 05:19:52 [DEBUG   ] Got command RPT from MCS: ref #11858
2021-04-01 05:19:52 [DEBUG   ] summary = ERROR
2021-04-01 05:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11858  13 59305 19192429 A  ERRORERROR'
2021-04-01 05:19:52 [DEBUG   ] Got command RPT from MCS: ref #11859
2021-04-01 05:19:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11859  77 59305 19192621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:19:52 [DEBUG   ] Got command RPT from MCS: ref #11860
2021-04-01 05:19:52 [DEBUG   ] summary = ERROR
2021-04-01 05:19:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11860  13 59305 19192825 A  ERRORERROR'
2021-04-01 05:19:53 [DEBUG   ] Got command RPT from MCS: ref #11861
2021-04-01 05:19:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11861  77 59305 19193029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:19:53 [DEBUG   ] Got command RPT from MCS: ref #11863
2021-04-01 05:19:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11863  12 59305 19193221 A  ERRORBš™š'
2021-04-01 05:20:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:20:08 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2021-04-01 05:20:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:20:08 [DEBUG   ] Finished updating board flags in 2.336 seconds
2021-04-01 05:20:28 [DEBUG   ] Finished updating ant stats in 0.549 seconds
2021-04-01 05:20:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 05:21:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 05:21:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:21:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:21:08 [DEBUG   ] Finished updating board flags in 2.121 seconds
2021-04-01 05:21:09 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-04-01 05:21:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 05:21:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:22:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:22:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:22:08 [DEBUG   ] Finished updating board flags in 1.995 seconds
2021-04-01 05:22:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 05:22:29 [DEBUG   ] Finished updating ant stats in 0.978 seconds
2021-04-01 05:22:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 05:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 05:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:23:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:23:08 [DEBUG   ] Finished updating board flags in 1.800 seconds
2021-04-01 05:23:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 05:23:29 [DEBUG   ] Finished updating ant stats in 0.787 seconds
2021-04-01 05:23:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 05:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:24:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:24:08 [DEBUG   ] Finished updating board flags in 1.779 seconds
2021-04-01 05:24:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 05:24:20 [DEBUG   ] Got command RPT from MCS: ref #11874
2021-04-01 05:24:20 [DEBUG   ] summary = ERROR
2021-04-01 05:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11874  13 59305 19460449 A  ERRORERROR'
2021-04-01 05:24:20 [DEBUG   ] Got command RPT from MCS: ref #11875
2021-04-01 05:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11875  77 59305 19460449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:24:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:24:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 05:24:52 [DEBUG   ] Got command RPT from MCS: ref #11893
2021-04-01 05:24:52 [DEBUG   ] summary = ERROR
2021-04-01 05:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11893  13 59305 19492493 A  ERRORERROR'
2021-04-01 05:24:52 [DEBUG   ] Got command RPT from MCS: ref #11895
2021-04-01 05:24:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11895  77 59305 19492697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:24:52 [DEBUG   ] Got command RPT from MCS: ref #11897
2021-04-01 05:24:52 [DEBUG   ] summary = ERROR
2021-04-01 05:24:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11897  13 59305 19492901 A  ERRORERROR'
2021-04-01 05:24:53 [DEBUG   ] Got command RPT from MCS: ref #11899
2021-04-01 05:24:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11899  77 59305 19493093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:24:53 [DEBUG   ] Got command RPT from MCS: ref #11901
2021-04-01 05:24:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11901  12 59305 19493297 A  ERRORB›™š'
2021-04-01 05:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:25:08 [DEBUG   ] Finished updating board flags in 1.576 seconds
2021-04-01 05:25:09 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2021-04-01 05:25:30 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 05:25:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-04-01 05:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 05:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:26:08 [DEBUG   ] Finished updating board flags in 1.431 seconds
2021-04-01 05:26:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:26:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:26:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 05:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:27:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:27:08 [DEBUG   ] Finished updating board flags in 1.370 seconds
2021-04-01 05:27:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 05:27:30 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2021-04-01 05:27:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:28:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:28:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:28:09 [DEBUG   ] Finished updating board flags in 2.276 seconds
2021-04-01 05:28:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:28:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:28:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 05:29:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:29:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:29:09 [DEBUG   ] Finished updating board flags in 2.231 seconds
2021-04-01 05:29:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:29:20 [DEBUG   ] Got command RPT from MCS: ref #11908
2021-04-01 05:29:20 [DEBUG   ] summary = ERROR
2021-04-01 05:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11908  13 59305 19760449 A  ERRORERROR'
2021-04-01 05:29:20 [DEBUG   ] Got command RPT from MCS: ref #11909
2021-04-01 05:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11909  77 59305 19760449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:29:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:29:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:29:52 [DEBUG   ] Got command RPT from MCS: ref #11927
2021-04-01 05:29:52 [DEBUG   ] summary = ERROR
2021-04-01 05:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11927  13 59305 19792565 A  ERRORERROR'
2021-04-01 05:29:52 [DEBUG   ] Got command RPT from MCS: ref #11928
2021-04-01 05:29:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11928  77 59305 19792782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:29:52 [DEBUG   ] Got command RPT from MCS: ref #11929
2021-04-01 05:29:52 [DEBUG   ] summary = ERROR
2021-04-01 05:29:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11929  13 59305 19792973 A  ERRORERROR'
2021-04-01 05:29:53 [DEBUG   ] Got command RPT from MCS: ref #11930
2021-04-01 05:29:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11930  77 59305 19793165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:29:53 [DEBUG   ] Got command RPT from MCS: ref #11932
2021-04-01 05:29:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11932  12 59305 19793369 A  ERRORBš™š'
2021-04-01 05:30:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:30:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:30:09 [DEBUG   ] Finished updating board flags in 2.258 seconds
2021-04-01 05:30:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:30:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:30:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:31:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:31:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:31:09 [DEBUG   ] Finished updating board flags in 2.081 seconds
2021-04-01 05:31:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:31:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 05:31:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:32:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:32:09 [DEBUG   ] Finished updating board flags in 2.026 seconds
2021-04-01 05:32:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:32:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 05:32:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 05:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:33:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:33:09 [DEBUG   ] Finished updating board flags in 2.019 seconds
2021-04-01 05:33:10 [DEBUG   ] Finished updating ant stats in 0.982 seconds
2021-04-01 05:33:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 05:33:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2021-04-01 05:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:34:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:34:09 [DEBUG   ] Finished updating board flags in 1.951 seconds
2021-04-01 05:34:10 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2021-04-01 05:34:20 [DEBUG   ] Got command RPT from MCS: ref #11949
2021-04-01 05:34:20 [DEBUG   ] summary = ERROR
2021-04-01 05:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11949  13 59305 20060445 A  ERRORERROR'
2021-04-01 05:34:20 [DEBUG   ] Got command RPT from MCS: ref #11950
2021-04-01 05:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11950  77 59305 20060445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:34:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 05:34:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:34:52 [DEBUG   ] Got command RPT from MCS: ref #11966
2021-04-01 05:34:52 [DEBUG   ] summary = ERROR
2021-04-01 05:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11966  13 59305 20092645 A  ERRORERROR'
2021-04-01 05:34:52 [DEBUG   ] Got command RPT from MCS: ref #11967
2021-04-01 05:34:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11967  77 59305 20092837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:34:53 [DEBUG   ] Got command RPT from MCS: ref #11968
2021-04-01 05:34:53 [DEBUG   ] summary = ERROR
2021-04-01 05:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11968  13 59305 20093041 A  ERRORERROR'
2021-04-01 05:34:53 [DEBUG   ] Got command RPT from MCS: ref #11969
2021-04-01 05:34:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11969  77 59305 20093245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:34:53 [DEBUG   ] Got command RPT from MCS: ref #11970
2021-04-01 05:34:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11970  12 59305 20093437 A  ERRORBš™š'
2021-04-01 05:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:35:09 [DEBUG   ] Finished updating board flags in 1.800 seconds
2021-04-01 05:35:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 05:35:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 05:35:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:36:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:36:09 [DEBUG   ] Finished updating board flags in 1.628 seconds
2021-04-01 05:36:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:36:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 05:36:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 05:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:37:09 [DEBUG   ] Finished updating board flags in 1.650 seconds
2021-04-01 05:37:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:37:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:37:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 05:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:38:09 [DEBUG   ] Finished updating board flags in 1.551 seconds
2021-04-01 05:38:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2021-04-01 05:38:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:38:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 05:39:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:39:09 [DEBUG   ] Finished updating board flags in 1.568 seconds
2021-04-01 05:39:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 05:39:20 [DEBUG   ] Got command RPT from MCS: ref #11977
2021-04-01 05:39:20 [DEBUG   ] summary = ERROR
2021-04-01 05:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11977  13 59305 20360453 A  ERRORERROR'
2021-04-01 05:39:20 [DEBUG   ] Got command RPT from MCS: ref #11978
2021-04-01 05:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11978  77 59305 20360453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:39:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 05:39:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 05:39:52 [DEBUG   ] Got command RPT from MCS: ref #11998
2021-04-01 05:39:52 [DEBUG   ] summary = ERROR
2021-04-01 05:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11998  13 59305 20392709 A  ERRORERROR'
2021-04-01 05:39:52 [DEBUG   ] Got command RPT from MCS: ref #12000
2021-04-01 05:39:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:39:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12000  77 59305 20392913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:39:53 [DEBUG   ] Got command RPT from MCS: ref #12002
2021-04-01 05:39:53 [DEBUG   ] summary = ERROR
2021-04-01 05:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12002  13 59305 20393117 A  ERRORERROR'
2021-04-01 05:39:53 [DEBUG   ] Got command RPT from MCS: ref #12004
2021-04-01 05:39:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12004  77 59305 20393309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:39:53 [DEBUG   ] Got command RPT from MCS: ref #12007
2021-04-01 05:39:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12007  12 59305 20393513 A  ERRORB™™š'
2021-04-01 05:40:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:40:10 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2021-04-01 05:40:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:40:10 [DEBUG   ] Finished updating board flags in 2.275 seconds
2021-04-01 05:40:30 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2021-04-01 05:40:50 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 05:41:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:41:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:41:10 [DEBUG   ] Finished updating board flags in 2.172 seconds
2021-04-01 05:41:11 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 05:41:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-04-01 05:41:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:42:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:42:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:42:10 [DEBUG   ] Finished updating board flags in 2.030 seconds
2021-04-01 05:42:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:42:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 05:42:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:43:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:43:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:43:10 [DEBUG   ] Finished updating board flags in 1.981 seconds
2021-04-01 05:43:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-04-01 05:43:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:43:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:44:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:44:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:44:10 [DEBUG   ] Finished updating board flags in 1.807 seconds
2021-04-01 05:44:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:44:20 [DEBUG   ] Got command RPT from MCS: ref #12018
2021-04-01 05:44:20 [DEBUG   ] summary = ERROR
2021-04-01 05:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12018  13 59305 20660449 A  ERRORERROR'
2021-04-01 05:44:20 [DEBUG   ] Got command RPT from MCS: ref #12019
2021-04-01 05:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12019  77 59305 20660449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:44:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 05:44:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:44:52 [DEBUG   ] Got command RPT from MCS: ref #12035
2021-04-01 05:44:52 [DEBUG   ] summary = ERROR
2021-04-01 05:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12035  13 59305 20692799 A  ERRORERROR'
2021-04-01 05:44:52 [DEBUG   ] Got command RPT from MCS: ref #12036
2021-04-01 05:44:52 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:44:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12036  77 59305 20692989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:44:53 [DEBUG   ] Got command RPT from MCS: ref #12037
2021-04-01 05:44:53 [DEBUG   ] summary = ERROR
2021-04-01 05:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12037  13 59305 20693181 A  ERRORERROR'
2021-04-01 05:44:53 [DEBUG   ] Got command RPT from MCS: ref #12038
2021-04-01 05:44:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12038  77 59305 20693385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:44:53 [DEBUG   ] Got command RPT from MCS: ref #12039
2021-04-01 05:44:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12039  12 59305 20693589 A  ERRORB˜™š'
2021-04-01 05:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:45:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:45:10 [DEBUG   ] Finished updating board flags in 1.830 seconds
2021-04-01 05:45:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 05:45:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 05:45:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-04-01 05:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:46:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:46:10 [DEBUG   ] Finished updating board flags in 1.769 seconds
2021-04-01 05:46:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 05:46:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 05:46:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 05:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:47:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:47:10 [DEBUG   ] Finished updating board flags in 1.660 seconds
2021-04-01 05:47:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 05:47:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2021-04-01 05:47:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 05:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:48:10 [DEBUG   ] Finished updating board flags in 1.491 seconds
2021-04-01 05:48:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 05:48:31 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2021-04-01 05:48:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 05:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:49:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:49:10 [DEBUG   ] Finished updating board flags in 1.471 seconds
2021-04-01 05:49:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:49:20 [DEBUG   ] Got command RPT from MCS: ref #12052
2021-04-01 05:49:20 [DEBUG   ] summary = ERROR
2021-04-01 05:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12052  13 59305 20960445 A  ERRORERROR'
2021-04-01 05:49:20 [DEBUG   ] Got command RPT from MCS: ref #12053
2021-04-01 05:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12053  77 59305 20960445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:49:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:49:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:49:52 [DEBUG   ] Got command RPT from MCS: ref #12071
2021-04-01 05:49:52 [DEBUG   ] summary = ERROR
2021-04-01 05:49:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12071  13 59305 20992857 A  ERRORERROR'
2021-04-01 05:49:53 [DEBUG   ] Got command RPT from MCS: ref #12072
2021-04-01 05:49:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12072  77 59305 20993061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:49:53 [DEBUG   ] Got command RPT from MCS: ref #12073
2021-04-01 05:49:53 [DEBUG   ] summary = ERROR
2021-04-01 05:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12073  13 59305 20993253 A  ERRORERROR'
2021-04-01 05:49:53 [DEBUG   ] Got command RPT from MCS: ref #12074
2021-04-01 05:49:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12074  77 59305 20993457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:49:53 [DEBUG   ] Got command RPT from MCS: ref #12076
2021-04-01 05:49:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12076  12 59305 20993661 A  ERRORBš™š'
2021-04-01 05:50:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:50:10 [DEBUG   ] Finished updating board flags in 1.506 seconds
2021-04-01 05:50:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 05:50:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:50:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:51:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:51:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:51:10 [DEBUG   ] Finished updating board flags in 1.511 seconds
2021-04-01 05:51:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 05:51:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:51:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 05:52:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:52:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:52:11 [DEBUG   ] Finished updating board flags in 2.202 seconds
2021-04-01 05:52:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:52:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:52:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:53:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:53:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:53:11 [DEBUG   ] Finished updating board flags in 2.234 seconds
2021-04-01 05:53:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:53:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:53:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 05:54:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:54:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:54:11 [DEBUG   ] Finished updating board flags in 2.154 seconds
2021-04-01 05:54:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 05:54:20 [DEBUG   ] Got command RPT from MCS: ref #12087
2021-04-01 05:54:20 [DEBUG   ] summary = ERROR
2021-04-01 05:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12087  13 59305 21260457 A  ERRORERROR'
2021-04-01 05:54:20 [DEBUG   ] Got command RPT from MCS: ref #12088
2021-04-01 05:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12088  77 59305 21260457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:54:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 05:54:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 05:54:52 [DEBUG   ] Got command RPT from MCS: ref #12106
2021-04-01 05:54:52 [DEBUG   ] summary = ERROR
2021-04-01 05:54:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12106  13 59305 21292929 A  ERRORERROR'
2021-04-01 05:54:53 [DEBUG   ] Got command RPT from MCS: ref #12108
2021-04-01 05:54:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12108  77 59305 21293133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:54:53 [DEBUG   ] Got command RPT from MCS: ref #12110
2021-04-01 05:54:53 [DEBUG   ] summary = ERROR
2021-04-01 05:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12110  13 59305 21293325 A  ERRORERROR'
2021-04-01 05:54:53 [DEBUG   ] Got command RPT from MCS: ref #12112
2021-04-01 05:54:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12112  77 59305 21293529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:54:53 [DEBUG   ] Got command RPT from MCS: ref #12114
2021-04-01 05:54:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12114  12 59305 21293733 A  ERRORBš™š'
2021-04-01 05:55:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:55:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:55:11 [DEBUG   ] Finished updating board flags in 2.065 seconds
2021-04-01 05:55:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 05:55:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 05:55:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:56:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:56:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:56:11 [DEBUG   ] Finished updating board flags in 1.910 seconds
2021-04-01 05:56:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:56:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:56:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:57:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:57:11 [DEBUG   ] Finished updating board flags in 1.838 seconds
2021-04-01 05:57:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:57:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:57:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:58:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:58:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:58:11 [DEBUG   ] Finished updating board flags in 1.769 seconds
2021-04-01 05:58:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:58:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:58:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:59:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 05:59:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 05:59:11 [DEBUG   ] Finished updating board flags in 1.636 seconds
2021-04-01 05:59:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 05:59:20 [DEBUG   ] Got command RPT from MCS: ref #12121
2021-04-01 05:59:20 [DEBUG   ] summary = ERROR
2021-04-01 05:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12121  13 59305 21560453 A  ERRORERROR'
2021-04-01 05:59:20 [DEBUG   ] Got command RPT from MCS: ref #12122
2021-04-01 05:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12122  77 59305 21560453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:59:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 05:59:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 05:59:53 [DEBUG   ] Got command RPT from MCS: ref #12140
2021-04-01 05:59:53 [DEBUG   ] summary = ERROR
2021-04-01 05:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12140  13 59305 21593005 A  ERRORERROR'
2021-04-01 05:59:53 [DEBUG   ] Got command RPT from MCS: ref #12141
2021-04-01 05:59:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12141  77 59305 21593209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:59:53 [DEBUG   ] Got command RPT from MCS: ref #12142
2021-04-01 05:59:53 [DEBUG   ] summary = ERROR
2021-04-01 05:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12142  13 59305 21593401 A  ERRORERROR'
2021-04-01 05:59:53 [DEBUG   ] Got command RPT from MCS: ref #12143
2021-04-01 05:59:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 05:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12143  77 59305 21593605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 05:59:53 [DEBUG   ] Got command RPT from MCS: ref #12145
2021-04-01 05:59:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 05:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12145  12 59305 21593809 A  ERRORBš™š'
2021-04-01 06:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:00:11 [DEBUG   ] Finished updating board flags in 1.587 seconds
2021-04-01 06:00:12 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 06:00:32 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2021-04-01 06:00:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:01:11 [DEBUG   ] Finished updating board flags in 1.422 seconds
2021-04-01 06:01:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:01:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:01:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:02:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:02:11 [DEBUG   ] Finished updating board flags in 1.485 seconds
2021-04-01 06:02:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:02:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:02:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:03:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:03:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:03:11 [DEBUG   ] Finished updating board flags in 1.582 seconds
2021-04-01 06:03:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 06:03:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 06:03:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 06:04:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:04:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:04:12 [DEBUG   ] Finished updating board flags in 2.128 seconds
2021-04-01 06:04:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-04-01 06:04:20 [DEBUG   ] Got command RPT from MCS: ref #12162
2021-04-01 06:04:20 [DEBUG   ] summary = ERROR
2021-04-01 06:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12162  13 59305 21860449 A  ERRORERROR'
2021-04-01 06:04:20 [DEBUG   ] Got command RPT from MCS: ref #12163
2021-04-01 06:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12163  77 59305 21860449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:04:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-04-01 06:04:53 [DEBUG   ] Got command RPT from MCS: ref #12179
2021-04-01 06:04:53 [DEBUG   ] summary = ERROR
2021-04-01 06:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12179  13 59305 21893073 A  ERRORERROR'
2021-04-01 06:04:53 [DEBUG   ] Got command RPT from MCS: ref #12180
2021-04-01 06:04:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12180  77 59305 21893277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:04:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:04:53 [DEBUG   ] Got command RPT from MCS: ref #12181
2021-04-01 06:04:53 [DEBUG   ] summary = ERROR
2021-04-01 06:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12181  13 59305 21893481 A  ERRORERROR'
2021-04-01 06:04:53 [DEBUG   ] Got command RPT from MCS: ref #12182
2021-04-01 06:04:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12182  77 59305 21893673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:04:53 [DEBUG   ] Got command RPT from MCS: ref #12183
2021-04-01 06:04:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12183  12 59305 21893877 A  ERRORB™™š'
2021-04-01 06:05:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:05:12 [DEBUG   ] Got command TBW from MCS: ref #12185
2021-04-01 06:05:12 [DEBUG   ] tbw = exited with status True, code 0x00
2021-04-01 06:05:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    12185   8 59305 21912073 A  ERROR'
2021-04-01 06:05:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:05:12 [DEBUG   ] Finished updating board flags in 2.029 seconds
2021-04-01 06:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2021-04-01 06:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2021-04-01 06:05:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2021-04-01 06:05:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2021-04-01 06:05:15 [DEBUG   ] spawn_process: at 2021-04-01 06:05:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2021-04-01 06:05:15 [INFO    ] Finished spawning TBW
2021-04-01 06:06:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:06:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:06:12 [DEBUG   ] Finished updating board flags in 1.767 seconds
2021-04-01 06:07:03 [INFO    ] __waitForTBW - TBW finished in 108.103 s
2021-04-01 06:07:04 [DEBUG   ] Finished updating ant stats in 0.521 seconds
2021-04-01 06:07:04 [INFO    ] Started antennas statistics background thread
2021-04-01 06:07:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1617257226']
2021-04-01 06:07:04 [DEBUG   ] spawn_process: at 2021-04-01 06:07:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1617257226']
2021-04-01 06:07:04 [INFO    ] Finished spawning TBN in 0.046 s
2021-04-01 06:07:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:07:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:07:12 [DEBUG   ] Finished updating board flags in 1.792 seconds
2021-04-01 06:07:24 [DEBUG   ] Finished updating ant stats in 0.469 seconds
2021-04-01 06:07:45 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2021-04-01 06:08:05 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2021-04-01 06:08:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:08:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:08:12 [DEBUG   ] Finished updating board flags in 1.556 seconds
2021-04-01 06:08:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:08:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 06:09:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 06:09:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 06:09:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:09:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:09:12 [DEBUG   ] Finished updating board flags in 1.484 seconds
2021-04-01 06:09:20 [DEBUG   ] Got command RPT from MCS: ref #12199
2021-04-01 06:09:20 [DEBUG   ] summary = ERROR
2021-04-01 06:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12199  13 59305 22160453 A  ERRORERROR'
2021-04-01 06:09:20 [DEBUG   ] Got command RPT from MCS: ref #12200
2021-04-01 06:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12200  77 59305 22160453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:09:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:09:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 06:09:53 [DEBUG   ] Got command RPT from MCS: ref #12220
2021-04-01 06:09:53 [DEBUG   ] summary = ERROR
2021-04-01 06:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12220  13 59305 22193145 A  ERRORERROR'
2021-04-01 06:09:53 [DEBUG   ] Got command RPT from MCS: ref #12222
2021-04-01 06:09:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12222  77 59305 22193349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:09:53 [DEBUG   ] Got command RPT from MCS: ref #12224
2021-04-01 06:09:53 [DEBUG   ] summary = ERROR
2021-04-01 06:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12224  13 59305 22193553 A  ERRORERROR'
2021-04-01 06:09:53 [DEBUG   ] Got command RPT from MCS: ref #12226
2021-04-01 06:09:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12226  77 59305 22193745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:09:53 [DEBUG   ] Got command RPT from MCS: ref #12229
2021-04-01 06:09:53 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12229  12 59305 22193949 A  ERRORBš™š'
2021-04-01 06:10:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:10:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 06:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:10:12 [DEBUG   ] Finished updating board flags in 1.568 seconds
2021-04-01 06:10:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 06:10:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:11:05 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2021-04-01 06:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:11:13 [DEBUG   ] Finished updating board flags in 2.232 seconds
2021-04-01 06:11:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 06:11:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 06:12:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:12:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:12:13 [DEBUG   ] Finished updating board flags in 2.112 seconds
2021-04-01 06:12:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 06:12:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:13:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:13:13 [DEBUG   ] Finished updating board flags in 2.055 seconds
2021-04-01 06:13:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:13:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 06:14:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 06:14:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:14:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:14:13 [DEBUG   ] Finished updating board flags in 1.967 seconds
2021-04-01 06:14:20 [DEBUG   ] Got command RPT from MCS: ref #12240
2021-04-01 06:14:20 [DEBUG   ] summary = ERROR
2021-04-01 06:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12240  13 59305 22460453 A  ERRORERROR'
2021-04-01 06:14:20 [DEBUG   ] Got command RPT from MCS: ref #12241
2021-04-01 06:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12241  77 59305 22460453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:14:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 06:14:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:14:53 [DEBUG   ] Got command RPT from MCS: ref #12257
2021-04-01 06:14:53 [DEBUG   ] summary = ERROR
2021-04-01 06:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12257  13 59305 22493217 A  ERRORERROR'
2021-04-01 06:14:53 [DEBUG   ] Got command RPT from MCS: ref #12258
2021-04-01 06:14:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12258  77 59305 22493421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:14:53 [DEBUG   ] Got command RPT from MCS: ref #12259
2021-04-01 06:14:53 [DEBUG   ] summary = ERROR
2021-04-01 06:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12259  13 59305 22493625 A  ERRORERROR'
2021-04-01 06:14:53 [DEBUG   ] Got command RPT from MCS: ref #12260
2021-04-01 06:14:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:14:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12260  77 59305 22493817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:14:54 [DEBUG   ] Got command RPT from MCS: ref #12261
2021-04-01 06:14:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12261  12 59305 22494021 A  ERRORBš™š'
2021-04-01 06:15:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 06:15:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:15:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:15:13 [DEBUG   ] Finished updating board flags in 1.820 seconds
2021-04-01 06:15:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:15:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:16:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:16:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:16:13 [DEBUG   ] Finished updating board flags in 1.792 seconds
2021-04-01 06:16:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:16:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:17:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:17:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 06:17:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:17:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:17:13 [DEBUG   ] Finished updating board flags in 1.665 seconds
2021-04-01 06:17:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:17:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:18:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:18:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:18:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:18:13 [DEBUG   ] Finished updating board flags in 1.520 seconds
2021-04-01 06:18:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:18:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:19:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:19:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:19:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:19:13 [DEBUG   ] Finished updating board flags in 1.496 seconds
2021-04-01 06:19:20 [DEBUG   ] Got command RPT from MCS: ref #12274
2021-04-01 06:19:20 [DEBUG   ] summary = ERROR
2021-04-01 06:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12274  13 59305 22760465 A  ERRORERROR'
2021-04-01 06:19:20 [DEBUG   ] Got command RPT from MCS: ref #12275
2021-04-01 06:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12275  77 59305 22760465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:19:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:19:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:19:53 [DEBUG   ] Got command RPT from MCS: ref #12293
2021-04-01 06:19:53 [DEBUG   ] summary = ERROR
2021-04-01 06:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12293  13 59305 22793297 A  ERRORERROR'
2021-04-01 06:19:53 [DEBUG   ] Got command RPT from MCS: ref #12294
2021-04-01 06:19:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12294  77 59305 22793489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:19:53 [DEBUG   ] Got command RPT from MCS: ref #12295
2021-04-01 06:19:53 [DEBUG   ] summary = ERROR
2021-04-01 06:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12295  13 59305 22793693 A  ERRORERROR'
2021-04-01 06:19:53 [DEBUG   ] Got command RPT from MCS: ref #12296
2021-04-01 06:19:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:19:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12296  77 59305 22793897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:19:54 [DEBUG   ] Got command RPT from MCS: ref #12298
2021-04-01 06:19:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12298  12 59305 22794089 A  ERRORB™™š'
2021-04-01 06:20:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:20:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:20:13 [DEBUG   ] Finished updating board flags in 1.528 seconds
2021-04-01 06:20:25 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2021-04-01 06:20:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2021-04-01 06:21:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-04-01 06:21:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:21:14 [DEBUG   ] Finished updating board flags in 2.245 seconds
2021-04-01 06:21:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 06:21:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 06:22:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 06:22:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:22:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:22:14 [DEBUG   ] Finished updating board flags in 2.141 seconds
2021-04-01 06:22:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-04-01 06:22:46 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2021-04-01 06:23:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:23:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:23:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:23:14 [DEBUG   ] Finished updating board flags in 2.021 seconds
2021-04-01 06:23:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:23:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:24:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:24:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:24:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:24:14 [DEBUG   ] Finished updating board flags in 1.988 seconds
2021-04-01 06:24:20 [DEBUG   ] Got command RPT from MCS: ref #12309
2021-04-01 06:24:20 [DEBUG   ] summary = ERROR
2021-04-01 06:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12309  13 59305 23060465 A  ERRORERROR'
2021-04-01 06:24:20 [DEBUG   ] Got command RPT from MCS: ref #12310
2021-04-01 06:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12310  77 59305 23060465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:24:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:24:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:24:53 [DEBUG   ] Got command RPT from MCS: ref #12328
2021-04-01 06:24:53 [DEBUG   ] summary = ERROR
2021-04-01 06:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12328  13 59305 23093373 A  ERRORERROR'
2021-04-01 06:24:53 [DEBUG   ] Got command RPT from MCS: ref #12330
2021-04-01 06:24:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12330  77 59305 23093565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:24:53 [DEBUG   ] Got command RPT from MCS: ref #12332
2021-04-01 06:24:53 [DEBUG   ] summary = ERROR
2021-04-01 06:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12332  13 59305 23093769 A  ERRORERROR'
2021-04-01 06:24:53 [DEBUG   ] Got command RPT from MCS: ref #12334
2021-04-01 06:24:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:24:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12334  77 59305 23093973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:24:54 [DEBUG   ] Got command RPT from MCS: ref #12336
2021-04-01 06:24:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12336  12 59305 23094165 A  ERRORB˜™š'
2021-04-01 06:25:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:25:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:25:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:25:14 [DEBUG   ] Finished updating board flags in 1.810 seconds
2021-04-01 06:25:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:25:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:26:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:26:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:26:14 [DEBUG   ] Finished updating board flags in 1.855 seconds
2021-04-01 06:26:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:26:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:27:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:27:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:27:14 [DEBUG   ] Finished updating board flags in 1.843 seconds
2021-04-01 06:27:26 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2021-04-01 06:27:46 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2021-04-01 06:28:06 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 06:28:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:28:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:28:14 [DEBUG   ] Finished updating board flags in 1.695 seconds
2021-04-01 06:28:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2021-04-01 06:28:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-04-01 06:29:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 06:29:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:29:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:29:14 [DEBUG   ] Finished updating board flags in 1.603 seconds
2021-04-01 06:29:20 [DEBUG   ] Got command RPT from MCS: ref #12343
2021-04-01 06:29:20 [DEBUG   ] summary = ERROR
2021-04-01 06:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12343  13 59305 23360461 A  ERRORERROR'
2021-04-01 06:29:20 [DEBUG   ] Got command RPT from MCS: ref #12344
2021-04-01 06:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12344  77 59305 23360461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:29:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 06:29:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:29:53 [DEBUG   ] Got command RPT from MCS: ref #12362
2021-04-01 06:29:53 [DEBUG   ] summary = ERROR
2021-04-01 06:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12362  13 59305 23393437 A  ERRORERROR'
2021-04-01 06:29:53 [DEBUG   ] Got command RPT from MCS: ref #12363
2021-04-01 06:29:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12363  77 59305 23393641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:29:53 [DEBUG   ] Got command RPT from MCS: ref #12364
2021-04-01 06:29:53 [DEBUG   ] summary = ERROR
2021-04-01 06:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12364  13 59305 23393845 A  ERRORERROR'
2021-04-01 06:29:54 [DEBUG   ] Got command RPT from MCS: ref #12365
2021-04-01 06:29:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12365  77 59305 23394037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:29:54 [DEBUG   ] Got command RPT from MCS: ref #12367
2021-04-01 06:29:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12367  12 59305 23394241 A  ERRORB˜™š'
2021-04-01 06:30:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 06:30:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:30:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:30:14 [DEBUG   ] Finished updating board flags in 1.617 seconds
2021-04-01 06:30:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:30:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 06:31:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:31:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:31:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:31:14 [DEBUG   ] Finished updating board flags in 1.586 seconds
2021-04-01 06:31:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 06:31:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:32:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 06:32:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 06:32:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:32:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:32:14 [DEBUG   ] Finished updating board flags in 1.440 seconds
2021-04-01 06:32:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:32:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-04-01 06:33:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:33:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 06:33:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:33:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:33:14 [DEBUG   ] Finished updating board flags in 1.537 seconds
2021-04-01 06:33:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 06:33:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:34:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-04-01 06:34:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:34:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:34:14 [DEBUG   ] Finished updating board flags in 1.576 seconds
2021-04-01 06:34:20 [DEBUG   ] Got command RPT from MCS: ref #12384
2021-04-01 06:34:20 [DEBUG   ] summary = ERROR
2021-04-01 06:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12384  13 59305 23660457 A  ERRORERROR'
2021-04-01 06:34:20 [DEBUG   ] Got command RPT from MCS: ref #12385
2021-04-01 06:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12385  77 59305 23660457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:34:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:34:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 06:34:53 [DEBUG   ] Got command RPT from MCS: ref #12401
2021-04-01 06:34:53 [DEBUG   ] summary = ERROR
2021-04-01 06:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12401  13 59305 23693517 A  ERRORERROR'
2021-04-01 06:34:53 [DEBUG   ] Got command RPT from MCS: ref #12402
2021-04-01 06:34:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12402  77 59305 23693709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:34:53 [DEBUG   ] Got command RPT from MCS: ref #12403
2021-04-01 06:34:53 [DEBUG   ] summary = ERROR
2021-04-01 06:34:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12403  13 59305 23693913 A  ERRORERROR'
2021-04-01 06:34:54 [DEBUG   ] Got command RPT from MCS: ref #12404
2021-04-01 06:34:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12404  77 59305 23694117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:34:54 [DEBUG   ] Got command RPT from MCS: ref #12405
2021-04-01 06:34:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12405  12 59305 23694321 A  ERRORBš™š'
2021-04-01 06:35:07 [DEBUG   ] Finished updating ant stats in 1.008 seconds
2021-04-01 06:35:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:35:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 06:35:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:35:15 [DEBUG   ] Finished updating board flags in 2.187 seconds
2021-04-01 06:35:27 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2021-04-01 06:35:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:36:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 06:36:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:36:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:36:15 [DEBUG   ] Finished updating board flags in 1.882 seconds
2021-04-01 06:36:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:36:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-04-01 06:37:07 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2021-04-01 06:37:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:37:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:37:15 [DEBUG   ] Finished updating board flags in 1.799 seconds
2021-04-01 06:37:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 06:37:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:38:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:38:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 06:38:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:38:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:38:15 [DEBUG   ] Finished updating board flags in 1.621 seconds
2021-04-01 06:38:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:38:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:39:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:39:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:39:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:39:15 [DEBUG   ] Finished updating board flags in 1.588 seconds
2021-04-01 06:39:20 [DEBUG   ] Got command RPT from MCS: ref #12412
2021-04-01 06:39:20 [DEBUG   ] summary = ERROR
2021-04-01 06:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12412  13 59305 23960461 A  ERRORERROR'
2021-04-01 06:39:20 [DEBUG   ] Got command RPT from MCS: ref #12413
2021-04-01 06:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12413  77 59305 23960461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:39:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:39:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:39:53 [DEBUG   ] Got command RPT from MCS: ref #12433
2021-04-01 06:39:53 [DEBUG   ] summary = ERROR
2021-04-01 06:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12433  13 59305 23993581 A  ERRORERROR'
2021-04-01 06:39:53 [DEBUG   ] Got command RPT from MCS: ref #12435
2021-04-01 06:39:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12435  77 59305 23993785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:39:53 [DEBUG   ] Got command RPT from MCS: ref #12437
2021-04-01 06:39:53 [DEBUG   ] summary = ERROR
2021-04-01 06:39:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12437  13 59305 23993989 A  ERRORERROR'
2021-04-01 06:39:54 [DEBUG   ] Got command RPT from MCS: ref #12439
2021-04-01 06:39:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12439  77 59305 23994181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:39:54 [DEBUG   ] Got command RPT from MCS: ref #12442
2021-04-01 06:39:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12442  12 59305 23994385 A  ERRORBš™š'
2021-04-01 06:40:07 [DEBUG   ] Finished updating ant stats in 0.612 seconds
2021-04-01 06:40:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 06:40:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:40:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:40:15 [DEBUG   ] Finished updating board flags in 1.468 seconds
2021-04-01 06:40:27 [DEBUG   ] Finished updating ant stats in 0.591 seconds
2021-04-01 06:40:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 06:41:08 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2021-04-01 06:41:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:41:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:41:15 [DEBUG   ] Finished updating board flags in 1.369 seconds
2021-04-01 06:41:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:41:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 06:42:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 06:42:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:42:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:42:16 [DEBUG   ] Finished updating board flags in 2.162 seconds
2021-04-01 06:42:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 06:42:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:43:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:43:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:43:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:43:16 [DEBUG   ] Finished updating board flags in 2.058 seconds
2021-04-01 06:43:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:43:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 06:44:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:44:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:44:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:44:16 [DEBUG   ] Finished updating board flags in 2.038 seconds
2021-04-01 06:44:20 [DEBUG   ] Got command RPT from MCS: ref #12453
2021-04-01 06:44:20 [DEBUG   ] summary = ERROR
2021-04-01 06:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12453  13 59305 24260469 A  ERRORERROR'
2021-04-01 06:44:20 [DEBUG   ] Got command RPT from MCS: ref #12454
2021-04-01 06:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12454  77 59305 24260469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:44:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 06:44:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 06:44:53 [DEBUG   ] Got command RPT from MCS: ref #12470
2021-04-01 06:44:53 [DEBUG   ] summary = ERROR
2021-04-01 06:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12470  13 59305 24293661 A  ERRORERROR'
2021-04-01 06:44:53 [DEBUG   ] Got command RPT from MCS: ref #12471
2021-04-01 06:44:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:44:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12471  77 59305 24293853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:44:54 [DEBUG   ] Got command RPT from MCS: ref #12472
2021-04-01 06:44:54 [DEBUG   ] summary = ERROR
2021-04-01 06:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12472  13 59305 24294057 A  ERRORERROR'
2021-04-01 06:44:54 [DEBUG   ] Got command RPT from MCS: ref #12473
2021-04-01 06:44:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12473  77 59305 24294261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:44:54 [DEBUG   ] Got command RPT from MCS: ref #12474
2021-04-01 06:44:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12474  12 59305 24294453 A  ERRORB™™š'
2021-04-01 06:45:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 06:45:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:45:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:45:16 [DEBUG   ] Finished updating board flags in 1.914 seconds
2021-04-01 06:45:28 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 06:45:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 06:46:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 06:46:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:46:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:46:16 [DEBUG   ] Finished updating board flags in 1.801 seconds
2021-04-01 06:46:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 06:46:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:47:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:47:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:47:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:47:16 [DEBUG   ] Finished updating board flags in 1.821 seconds
2021-04-01 06:47:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 06:47:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 06:48:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:48:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:48:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:48:16 [DEBUG   ] Finished updating board flags in 1.768 seconds
2021-04-01 06:48:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 06:48:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 06:49:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:49:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:49:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:49:16 [DEBUG   ] Finished updating board flags in 1.619 seconds
2021-04-01 06:49:20 [DEBUG   ] Got command RPT from MCS: ref #12487
2021-04-01 06:49:20 [DEBUG   ] summary = ERROR
2021-04-01 06:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12487  13 59305 24560465 A  ERRORERROR'
2021-04-01 06:49:20 [DEBUG   ] Got command RPT from MCS: ref #12488
2021-04-01 06:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12488  77 59305 24560465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:49:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 06:49:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 06:49:53 [DEBUG   ] Got command RPT from MCS: ref #12506
2021-04-01 06:49:53 [DEBUG   ] summary = ERROR
2021-04-01 06:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12506  13 59305 24593729 A  ERRORERROR'
2021-04-01 06:49:53 [DEBUG   ] Got command RPT from MCS: ref #12507
2021-04-01 06:49:53 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:49:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12507  77 59305 24593933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:49:54 [DEBUG   ] Got command RPT from MCS: ref #12508
2021-04-01 06:49:54 [DEBUG   ] summary = ERROR
2021-04-01 06:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12508  13 59305 24594125 A  ERRORERROR'
2021-04-01 06:49:54 [DEBUG   ] Got command RPT from MCS: ref #12509
2021-04-01 06:49:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12509  77 59305 24594329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:49:54 [DEBUG   ] Got command RPT from MCS: ref #12511
2021-04-01 06:49:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12511  12 59305 24594533 A  ERRORB˜™š'
2021-04-01 06:50:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:50:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:50:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:50:16 [DEBUG   ] Finished updating board flags in 1.626 seconds
2021-04-01 06:50:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 06:50:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:51:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 06:51:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:51:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:51:16 [DEBUG   ] Finished updating board flags in 1.569 seconds
2021-04-01 06:51:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 06:51:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 06:52:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 06:52:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:52:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:52:16 [DEBUG   ] Finished updating board flags in 1.385 seconds
2021-04-01 06:52:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:52:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:53:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 06:53:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:53:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:53:16 [DEBUG   ] Finished updating board flags in 1.420 seconds
2021-04-01 06:53:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 06:53:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:54:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 06:54:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:54:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:54:17 [DEBUG   ] Finished updating board flags in 2.281 seconds
2021-04-01 06:54:20 [DEBUG   ] Got command RPT from MCS: ref #12522
2021-04-01 06:54:20 [DEBUG   ] summary = ERROR
2021-04-01 06:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12522  13 59305 24860465 A  ERRORERROR'
2021-04-01 06:54:20 [DEBUG   ] Got command RPT from MCS: ref #12523
2021-04-01 06:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12523  77 59305 24860465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:54:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 06:54:49 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2021-04-01 06:54:53 [DEBUG   ] Got command RPT from MCS: ref #12541
2021-04-01 06:54:53 [DEBUG   ] summary = ERROR
2021-04-01 06:54:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12541  13 59305 24893797 A  ERRORERROR'
2021-04-01 06:54:54 [DEBUG   ] Got command RPT from MCS: ref #12543
2021-04-01 06:54:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12543  77 59305 24894001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:54:54 [DEBUG   ] Got command RPT from MCS: ref #12545
2021-04-01 06:54:54 [DEBUG   ] summary = ERROR
2021-04-01 06:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12545  13 59305 24894205 A  ERRORERROR'
2021-04-01 06:54:54 [DEBUG   ] Got command RPT from MCS: ref #12547
2021-04-01 06:54:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12547  77 59305 24894397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:54:54 [DEBUG   ] Got command RPT from MCS: ref #12549
2021-04-01 06:54:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12549  12 59305 24894601 A  ERRORB™™š'
2021-04-01 06:55:09 [DEBUG   ] Finished updating ant stats in 1.220 seconds
2021-04-01 06:55:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:55:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:55:17 [DEBUG   ] Finished updating board flags in 2.133 seconds
2021-04-01 06:55:29 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2021-04-01 06:55:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:56:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:56:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 06:56:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:56:17 [DEBUG   ] Finished updating board flags in 1.976 seconds
2021-04-01 06:56:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:56:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 06:57:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 06:57:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:57:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:57:17 [DEBUG   ] Finished updating board flags in 1.797 seconds
2021-04-01 06:57:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 06:57:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 06:58:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 06:58:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:58:17 [DEBUG   ] Finished updating board flags in 1.636 seconds
2021-04-01 06:58:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 06:58:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2021-04-01 06:59:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 06:59:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 06:59:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 06:59:17 [DEBUG   ] Finished updating board flags in 1.570 seconds
2021-04-01 06:59:20 [DEBUG   ] Got command RPT from MCS: ref #12556
2021-04-01 06:59:20 [DEBUG   ] summary = ERROR
2021-04-01 06:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12556  13 59305 25160469 A  ERRORERROR'
2021-04-01 06:59:20 [DEBUG   ] Got command RPT from MCS: ref #12557
2021-04-01 06:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12557  77 59305 25160469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:59:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 06:59:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 06:59:53 [DEBUG   ] Got command RPT from MCS: ref #12575
2021-04-01 06:59:53 [DEBUG   ] summary = ERROR
2021-04-01 06:59:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12575  13 59305 25193869 A  ERRORERROR'
2021-04-01 06:59:54 [DEBUG   ] Got command RPT from MCS: ref #12576
2021-04-01 06:59:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12576  77 59305 25194073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:59:54 [DEBUG   ] Got command RPT from MCS: ref #12577
2021-04-01 06:59:54 [DEBUG   ] summary = ERROR
2021-04-01 06:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12577  13 59305 25194277 A  ERRORERROR'
2021-04-01 06:59:54 [DEBUG   ] Got command RPT from MCS: ref #12578
2021-04-01 06:59:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 06:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12578  77 59305 25194481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 06:59:54 [DEBUG   ] Got command RPT from MCS: ref #12580
2021-04-01 06:59:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 06:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12580  12 59305 25194673 A  ERRORBš™š'
2021-04-01 07:00:09 [DEBUG   ] Finished updating ant stats in 0.808 seconds
2021-04-01 07:00:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:00:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:00:17 [DEBUG   ] Finished updating board flags in 1.441 seconds
2021-04-01 07:00:29 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2021-04-01 07:00:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 07:01:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 07:01:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:01:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:01:17 [DEBUG   ] Finished updating board flags in 1.419 seconds
2021-04-01 07:01:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 07:01:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:02:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 07:02:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 07:02:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:02:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:02:17 [DEBUG   ] Finished updating board flags in 1.505 seconds
2021-04-01 07:02:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 07:02:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:03:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 07:03:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:03:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:03:17 [DEBUG   ] Finished updating board flags in 1.570 seconds
2021-04-01 07:03:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 07:03:49 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 07:04:09 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2021-04-01 07:04:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:04:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:04:18 [DEBUG   ] Finished updating board flags in 2.172 seconds
2021-04-01 07:04:20 [DEBUG   ] Got command RPT from MCS: ref #12597
2021-04-01 07:04:20 [DEBUG   ] summary = ERROR
2021-04-01 07:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12597  13 59305 25460469 A  ERRORERROR'
2021-04-01 07:04:20 [DEBUG   ] Got command RPT from MCS: ref #12598
2021-04-01 07:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12598  77 59305 25460469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:04:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:04:49 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-04-01 07:04:53 [DEBUG   ] Got command RPT from MCS: ref #12614
2021-04-01 07:04:53 [DEBUG   ] summary = ERROR
2021-04-01 07:04:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12614  13 59305 25493949 A  ERRORERROR'
2021-04-01 07:04:54 [DEBUG   ] Got command RPT from MCS: ref #12615
2021-04-01 07:04:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12615  77 59305 25494153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:04:54 [DEBUG   ] Got command RPT from MCS: ref #12616
2021-04-01 07:04:54 [DEBUG   ] summary = ERROR
2021-04-01 07:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12616  13 59305 25494345 A  ERRORERROR'
2021-04-01 07:04:54 [DEBUG   ] Got command RPT from MCS: ref #12617
2021-04-01 07:04:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12617  77 59305 25494549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:04:54 [DEBUG   ] Got command RPT from MCS: ref #12618
2021-04-01 07:04:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12618  12 59305 25494753 A  ERRORBš™š'
2021-04-01 07:05:09 [DEBUG   ] Finished updating ant stats in 0.410 seconds
2021-04-01 07:05:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 07:05:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:05:18 [DEBUG   ] Finished updating board flags in 1.938 seconds
2021-04-01 07:05:30 [DEBUG   ] Finished updating ant stats in 1.387 seconds
2021-04-01 07:05:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2021-04-01 07:06:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 07:06:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:06:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:06:18 [DEBUG   ] Finished updating board flags in 1.796 seconds
2021-04-01 07:06:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:06:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:07:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 07:07:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:07:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:07:18 [DEBUG   ] Finished updating board flags in 1.568 seconds
2021-04-01 07:07:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:07:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2021-04-01 07:08:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 07:08:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:08:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:08:18 [DEBUG   ] Finished updating board flags in 1.428 seconds
2021-04-01 07:08:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 07:08:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:09:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:09:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:09:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:09:18 [DEBUG   ] Finished updating board flags in 1.369 seconds
2021-04-01 07:09:20 [DEBUG   ] Got command RPT from MCS: ref #12625
2021-04-01 07:09:20 [DEBUG   ] summary = ERROR
2021-04-01 07:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12625  13 59305 25760477 A  ERRORERROR'
2021-04-01 07:09:20 [DEBUG   ] Got command RPT from MCS: ref #12626
2021-04-01 07:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12626  77 59305 25760477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:09:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:09:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 07:09:54 [DEBUG   ] Got command RPT from MCS: ref #12646
2021-04-01 07:09:54 [DEBUG   ] summary = ERROR
2021-04-01 07:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12646  13 59305 25794025 A  ERRORERROR'
2021-04-01 07:09:54 [DEBUG   ] Got command RPT from MCS: ref #12648
2021-04-01 07:09:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12648  77 59305 25794217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:09:54 [DEBUG   ] Got command RPT from MCS: ref #12650
2021-04-01 07:09:54 [DEBUG   ] summary = ERROR
2021-04-01 07:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12650  13 59305 25794421 A  ERRORERROR'
2021-04-01 07:09:54 [DEBUG   ] Got command RPT from MCS: ref #12652
2021-04-01 07:09:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12652  77 59305 25794625 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:09:54 [DEBUG   ] Got command RPT from MCS: ref #12655
2021-04-01 07:09:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12655  12 59305 25794829 A  ERRORB™™š'
2021-04-01 07:10:10 [DEBUG   ] Finished updating ant stats in 1.212 seconds
2021-04-01 07:10:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:10:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:10:19 [DEBUG   ] Finished updating board flags in 1.610 seconds
2021-04-01 07:10:30 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2021-04-01 07:10:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:11:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 07:11:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:11:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:11:19 [DEBUG   ] Finished updating board flags in 2.292 seconds
2021-04-01 07:11:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 07:11:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 07:12:00 [DEBUG   ] Got command RPT from MCS: ref #12660
2021-04-01 07:12:00 [DEBUG   ] summary = ERROR
2021-04-01 07:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12660  13 59305 25920785 A  ERRORERROR'
2021-04-01 07:12:00 [DEBUG   ] Got command RPT from MCS: ref #12661
2021-04-01 07:12:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:12:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12661  77 59305 25920785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:12:05 [DEBUG   ] Got command INI from MCS: ref #12662
2021-04-01 07:12:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2021-04-01 07:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    12662   8 59305 25925797 ABOOTING'
2021-04-01 07:12:10 [WARNING ] AntennaStats: no access to lwa28
2021-04-01 07:12:10 [WARNING ] AntennaStats: last command was /usr/local/bin/lwa28 /lwa/software/amplitude
2021-04-01 07:12:10 [WARNING ] AntennaStats: last command output as 
2021-04-01 07:12:10 [DEBUG   ] Finished updating ant stats in 0.715 seconds
2021-04-01 07:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:12:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:12:19 [DEBUG   ] Finished updating board flags in 2.110 seconds
2021-04-01 07:12:29 [INFO    ] -------------------
2021-04-01 07:12:29 [INFO    ]  LWA board status
2021-04-01 07:12:29 [INFO    ] -------------------
2021-04-01 07:12:29 [INFO    ] DP 1: 2 lwa27
2021-04-01 07:12:29 [INFO    ] DP 1: 3 lwa24
2021-04-01 07:12:29 [INFO    ] DP 1: 4 lwa23
2021-04-01 07:12:29 [INFO    ] DP 1: 5 lwa18
2021-04-01 07:12:29 [INFO    ] DP 1: 6 lwa10
2021-04-01 07:12:29 [INFO    ] DP 1: 7 lwa32
2021-04-01 07:12:29 [INFO    ] DP 1: 8 lwa11
2021-04-01 07:12:29 [INFO    ] DP 1: 9 lwa30
2021-04-01 07:12:29 [INFO    ] DP 1: 10 lwa12
2021-04-01 07:12:29 [INFO    ] DP 1: 11 lwa8
2021-04-01 07:12:29 [INFO    ] DP 1: 12 lwa13
2021-04-01 07:12:29 [INFO    ] DP 1: 13 lwa26
2021-04-01 07:12:29 [INFO    ] DP 1: 14 lwa14
2021-04-01 07:12:29 [INFO    ] DP 1: 16 lwa22
2021-04-01 07:12:29 [INFO    ] DP 1: 17 lwa20
2021-04-01 07:12:29 [INFO    ] DP 1: 18 lwa1
2021-04-01 07:12:29 [INFO    ] DP 1: 19 lwa5
2021-04-01 07:12:29 [INFO    ] DP 1: 20 lwa25
2021-04-01 07:12:29 [INFO    ] DP 1: 21 lwa35
2021-04-01 07:12:29 [INFO    ] DP 1: 22 lwa19
2021-04-01 07:12:29 [INFO    ] DP 1: 23 lwa21
2021-04-01 07:12:29 [INFO    ] DP 1: 24 lwa6
2021-04-01 07:12:29 [INFO    ] DP 1: 25 lwa7
2021-04-01 07:12:29 [INFO    ] DP 1: 26 lwa33
2021-04-01 07:12:29 [INFO    ] DP 1: 27 lwa15
2021-04-01 07:12:29 [INFO    ] DP 1: 28 lwa28
2021-04-01 07:12:29 [INFO    ] DP 2: 1 lwa16
2021-04-01 07:12:29 [INFO    ] DP 2: 15 lwa34
2021-04-01 07:12:29 [INFO    ] Total of 28 boards
2021-04-01 07:12:29 [INFO    ] Total of 260 stands
2021-04-01 07:12:29 [INFO    ] -------------------
2021-04-01 07:12:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16185
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16186
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16187
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16188
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16189
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16190
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16191
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16192
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16193
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16194
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16195
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16196
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16197
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16198
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16199
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16200
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16201
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16202
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16203
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16204
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16205
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16206
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16207
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16208
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16209
2021-04-01 07:12:36 [DEBUG   ] 2021-04-01 07:12:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 16210
2021-04-01 07:12:48 [DEBUG   ] 2021-04-01 07:12:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16185 exited with status 0
2021-04-01 07:12:48 [DEBUG   ] 2021-04-01 07:12:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16186 exited with status 0
2021-04-01 07:12:48 [DEBUG   ] 2021-04-01 07:12:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16187 exited with status 0
2021-04-01 07:12:48 [DEBUG   ] 2021-04-01 07:12:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16188 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16189 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16190 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16191 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16192 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16193 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16194 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16195 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16196 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16197 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16198 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16199 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16200 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16201 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16202 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16203 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16204 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16205 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16206 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16207 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16208 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16209 exited with status 0
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 16210 exited with status 0
2021-04-01 07:12:49 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] spawn_process: at 2021-04-01 07:12:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16237
2021-04-01 07:12:49 [DEBUG   ] 2021-04-01 07:12:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 16238
2021-04-01 07:12:54 [DEBUG   ] 2021-04-01 07:12:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16237 exited with status 0
2021-04-01 07:12:54 [DEBUG   ] 2021-04-01 07:12:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 16238 exited with status 0
2021-04-01 07:12:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2021-04-01 07:12:54 [DEBUG   ] spawn_process: at 2021-04-01 07:12:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2021-04-01 07:12:54 [DEBUG   ] spawn_process: at 2021-04-01 07:12:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2021-04-01 07:12:54 [INFO    ] Setting Beam 1 xbars
2021-04-01 07:12:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2021-04-01 07:12:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2021-04-01 07:12:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2021-04-01 07:12:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2021-04-01 07:12:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2021-04-01 07:12:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2021-04-01 07:12:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2021-04-01 07:12:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2021-04-01 07:12:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2021-04-01 07:12:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2021-04-01 07:12:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2021-04-01 07:12:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2021-04-01 07:12:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2021-04-01 07:12:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2021-04-01 07:12:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2021-04-01 07:12:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2021-04-01 07:12:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2021-04-01 07:12:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2021-04-01 07:12:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2021-04-01 07:12:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2021-04-01 07:12:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2021-04-01 07:12:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2021-04-01 07:12:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2021-04-01 07:12:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2021-04-01 07:12:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2021-04-01 07:12:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2021-04-01 07:12:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2021-04-01 07:12:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2021-04-01 07:12:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2021-04-01 07:12:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2021-04-01 07:12:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2021-04-01 07:12:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2021-04-01 07:13:00 [INFO    ] Setting Beam 2 xbars
2021-04-01 07:13:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2021-04-01 07:13:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2021-04-01 07:13:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2021-04-01 07:13:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2021-04-01 07:13:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2021-04-01 07:13:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2021-04-01 07:13:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2021-04-01 07:13:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2021-04-01 07:13:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2021-04-01 07:13:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2021-04-01 07:13:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2021-04-01 07:13:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2021-04-01 07:13:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2021-04-01 07:13:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2021-04-01 07:13:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2021-04-01 07:13:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2021-04-01 07:13:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2021-04-01 07:13:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2021-04-01 07:13:02 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2021-04-01 07:13:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2021-04-01 07:13:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2021-04-01 07:13:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2021-04-01 07:13:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2021-04-01 07:13:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2021-04-01 07:13:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2021-04-01 07:13:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2021-04-01 07:13:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2021-04-01 07:13:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2021-04-01 07:13:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2021-04-01 07:13:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2021-04-01 07:13:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2021-04-01 07:13:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2021-04-01 07:13:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2021-04-01 07:13:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2021-04-01 07:13:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2021-04-01 07:13:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2021-04-01 07:13:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2021-04-01 07:13:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2021-04-01 07:13:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2021-04-01 07:13:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2021-04-01 07:13:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2021-04-01 07:13:05 [INFO    ] Setting Beam 3 xbars
2021-04-01 07:13:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2021-04-01 07:13:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2021-04-01 07:13:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2021-04-01 07:13:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2021-04-01 07:13:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2021-04-01 07:13:06 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2021-04-01 07:13:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2021-04-01 07:13:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2021-04-01 07:13:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2021-04-01 07:13:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2021-04-01 07:13:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2021-04-01 07:13:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2021-04-01 07:13:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2021-04-01 07:13:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2021-04-01 07:13:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2021-04-01 07:13:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2021-04-01 07:13:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2021-04-01 07:13:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2021-04-01 07:13:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2021-04-01 07:13:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2021-04-01 07:13:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2021-04-01 07:13:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2021-04-01 07:13:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2021-04-01 07:13:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2021-04-01 07:13:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2021-04-01 07:13:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2021-04-01 07:13:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2021-04-01 07:13:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2021-04-01 07:13:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2021-04-01 07:13:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2021-04-01 07:13:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2021-04-01 07:13:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2021-04-01 07:13:09 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2021-04-01 07:13:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2021-04-01 07:13:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2021-04-01 07:13:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2021-04-01 07:13:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2021-04-01 07:13:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2021-04-01 07:13:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2021-04-01 07:13:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2021-04-01 07:13:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2021-04-01 07:13:10 [INFO    ] Setting Beam 4 xbars
2021-04-01 07:13:10 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2021-04-01 07:13:10 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2021-04-01 07:13:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2021-04-01 07:13:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2021-04-01 07:13:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2021-04-01 07:13:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2021-04-01 07:13:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2021-04-01 07:13:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2021-04-01 07:13:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2021-04-01 07:13:11 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2021-04-01 07:13:11 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2021-04-01 07:13:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2021-04-01 07:13:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2021-04-01 07:13:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2021-04-01 07:13:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2021-04-01 07:13:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2021-04-01 07:13:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2021-04-01 07:13:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2021-04-01 07:13:12 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2021-04-01 07:13:12 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2021-04-01 07:13:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2021-04-01 07:13:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2021-04-01 07:13:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2021-04-01 07:13:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2021-04-01 07:13:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2021-04-01 07:13:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2021-04-01 07:13:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2021-04-01 07:13:13 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2021-04-01 07:13:13 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2021-04-01 07:13:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2021-04-01 07:13:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2021-04-01 07:13:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2021-04-01 07:13:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2021-04-01 07:13:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2021-04-01 07:13:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2021-04-01 07:13:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2021-04-01 07:13:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2021-04-01 07:13:14 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2021-04-01 07:13:15 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2021-04-01 07:13:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2021-04-01 07:13:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2021-04-01 07:13:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2021-04-01 07:13:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2021-04-01 07:13:16 [INFO    ] All xbars set
2021-04-01 07:13:16 [INFO    ] Setting adder chain routing for all beams
2021-04-01 07:13:21 [INFO    ] Setting beam ids
2021-04-01 07:13:31 [INFO    ] Starting beam delay calibration
2021-04-01 07:13:43 [INFO    ] Beam 1 latency is 5765
2021-04-01 07:13:43 [INFO    ] Beam 2 latency is 5738
2021-04-01 07:13:43 [INFO    ] Beam 3 latency is 5717
2021-04-01 07:13:43 [INFO    ] Beam 4 latency is 5742
2021-04-01 07:13:43 [INFO    ] Stop calibration
2021-04-01 07:13:51 [INFO    ] Beam delay calibration successful
2021-04-01 07:13:51 [INFO    ] Calibration passed
2021-04-01 07:13:51 [DEBUG   ] spawn_process: at 2021-04-01 07:13:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2021-04-01 07:13:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2021-04-01 07:13:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2021-04-01 07:13:51 [DEBUG   ] spawn_process: at 2021-04-01 07:13:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2021-04-01 07:13:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2021-04-01 07:13:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2021-04-01 07:13:51 [DEBUG   ] spawn_process: at 2021-04-01 07:13:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2021-04-01 07:13:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2021-04-01 07:13:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2021-04-01 07:13:51 [DEBUG   ] spawn_process: at 2021-04-01 07:13:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2021-04-01 07:13:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2021-04-01 07:13:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2021-04-01 07:13:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2021-04-01 07:13:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 291 ms (1617261232.292 s) with PID 17812 and time 1617261233
2021-04-01 07:13:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2021-04-01 07:13:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 378 ms (1617261232.380 s) with PID 17815 and time 1617261233
2021-04-01 07:13:53 [DEBUG   ] Finished updating ant stats in 0.867 seconds
2021-04-01 07:13:53 [INFO    ] Started antennas statistics background thread
2021-04-01 07:13:53 [INFO    ] Started board flags background thread
2021-04-01 07:13:53 [INFO    ] Started BAM background thread
2021-04-01 07:13:53 [INFO    ] Finished the INI process (ref. #12662) in 107.704 s
2021-04-01 07:13:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:13:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2021-04-01 07:13:54 [DEBUG   ] Finished updating board flags in 1.069 seconds
2021-04-01 07:14:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:14:20 [DEBUG   ] Got command RPT from MCS: ref #12669
2021-04-01 07:14:20 [DEBUG   ] summary = ERROR
2021-04-01 07:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12669  13 59305 26060473 A  ERRORERROR'
2021-04-01 07:14:20 [DEBUG   ] Got command RPT from MCS: ref #12670
2021-04-01 07:14:20 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12670  98 59305 26060473 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:14:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:14:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:14:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:14:54 [DEBUG   ] Got command RPT from MCS: ref #12686
2021-04-01 07:14:54 [DEBUG   ] summary = ERROR
2021-04-01 07:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12686  13 59305 26094089 A  ERRORERROR'
2021-04-01 07:14:54 [DEBUG   ] Got command RPT from MCS: ref #12687
2021-04-01 07:14:54 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12687  98 59305 26094297 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:14:54 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2021-04-01 07:14:54 [DEBUG   ] Finished updating board flags in 0.979 seconds
2021-04-01 07:14:54 [DEBUG   ] Got command RPT from MCS: ref #12688
2021-04-01 07:14:54 [DEBUG   ] summary = ERROR
2021-04-01 07:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12688  13 59305 26094501 A  ERRORERROR'
2021-04-01 07:14:54 [DEBUG   ] Got command RPT from MCS: ref #12689
2021-04-01 07:14:54 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12689  98 59305 26094693 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:14:54 [DEBUG   ] Got command RPT from MCS: ref #12690
2021-04-01 07:14:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12690  12 59305 26094897 A  ERRORB˜™š'
2021-04-01 07:15:05 [DEBUG   ] Got command RPT from MCS: ref #12691
2021-04-01 07:15:05 [DEBUG   ] summary = ERROR
2021-04-01 07:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12691  13 59305 26105793 A  ERRORERROR'
2021-04-01 07:15:05 [DEBUG   ] Got command RPT from MCS: ref #12692
2021-04-01 07:15:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:15:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12692  98 59305 26105793 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:15:10 [DEBUG   ] Got command INI from MCS: ref #12693
2021-04-01 07:15:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2021-04-01 07:15:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    12693   8 59305 26110801 ABOOTING'
2021-04-01 07:15:13 [DEBUG   ] Finished updating ant stats in 0.823 seconds
2021-04-01 07:15:31 [INFO    ] -------------------
2021-04-01 07:15:31 [INFO    ]  LWA board status
2021-04-01 07:15:31 [INFO    ] -------------------
2021-04-01 07:15:31 [INFO    ] DP 1: 2 lwa27
2021-04-01 07:15:31 [INFO    ] DP 1: 3 lwa24
2021-04-01 07:15:31 [INFO    ] DP 1: 4 lwa23
2021-04-01 07:15:31 [INFO    ] DP 1: 5 lwa18
2021-04-01 07:15:31 [INFO    ] DP 1: 6 lwa10
2021-04-01 07:15:31 [INFO    ] DP 1: 7 lwa32
2021-04-01 07:15:31 [INFO    ] DP 1: 8 lwa11
2021-04-01 07:15:31 [INFO    ] DP 1: 9 lwa30
2021-04-01 07:15:31 [INFO    ] DP 1: 10 lwa12
2021-04-01 07:15:31 [INFO    ] DP 1: 11 lwa8
2021-04-01 07:15:31 [INFO    ] DP 1: 12 lwa13
2021-04-01 07:15:31 [INFO    ] DP 1: 13 lwa26
2021-04-01 07:15:31 [INFO    ] DP 1: 14 lwa14
2021-04-01 07:15:31 [INFO    ] DP 1: 16 lwa22
2021-04-01 07:15:31 [INFO    ] DP 1: 17 lwa20
2021-04-01 07:15:31 [INFO    ] DP 1: 18 lwa1
2021-04-01 07:15:31 [INFO    ] DP 1: 19 lwa5
2021-04-01 07:15:31 [INFO    ] DP 1: 20 lwa25
2021-04-01 07:15:31 [INFO    ] DP 1: 21 lwa35
2021-04-01 07:15:31 [INFO    ] DP 1: 22 lwa19
2021-04-01 07:15:31 [INFO    ] DP 1: 23 lwa21
2021-04-01 07:15:31 [INFO    ] DP 1: 24 lwa6
2021-04-01 07:15:31 [INFO    ] DP 1: 25 lwa7
2021-04-01 07:15:31 [INFO    ] DP 1: 26 lwa33
2021-04-01 07:15:31 [INFO    ] DP 1: 27 lwa15
2021-04-01 07:15:31 [INFO    ] DP 1: 28 lwa28
2021-04-01 07:15:31 [INFO    ] DP 2: 1 lwa16
2021-04-01 07:15:31 [INFO    ] DP 2: 15 lwa34
2021-04-01 07:15:31 [INFO    ] Total of 28 boards
2021-04-01 07:15:31 [INFO    ] Total of 260 stands
2021-04-01 07:15:31 [INFO    ] -------------------
2021-04-01 07:15:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18371
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18372
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18373
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18374
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18375
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18376
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18377
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18378
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18379
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18380
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18381
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18382
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18383
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18384
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18385
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18386
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18387
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18388
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18389
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18390
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18391
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18392
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18393
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18394
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18395
2021-04-01 07:15:38 [DEBUG   ] 2021-04-01 07:15:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18396
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18371 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18372 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18373 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18374 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18375 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18376 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18377 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18378 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18379 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18380 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18381 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18382 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18383 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18384 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18385 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18386 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18387 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18388 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18389 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18390 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18391 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18392 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18393 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18394 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18395 exited with status 0
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18396 exited with status 0
2021-04-01 07:15:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] spawn_process: at 2021-04-01 07:15:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18423
2021-04-01 07:15:50 [DEBUG   ] 2021-04-01 07:15:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18424
2021-04-01 07:15:56 [DEBUG   ] 2021-04-01 07:15:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18423 exited with status 0
2021-04-01 07:15:56 [DEBUG   ] 2021-04-01 07:15:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18424 exited with status 0
2021-04-01 07:15:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2021-04-01 07:15:56 [DEBUG   ] spawn_process: at 2021-04-01 07:15:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2021-04-01 07:15:56 [DEBUG   ] spawn_process: at 2021-04-01 07:15:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2021-04-01 07:15:56 [INFO    ] Setting Beam 1 xbars
2021-04-01 07:15:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2021-04-01 07:15:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2021-04-01 07:15:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2021-04-01 07:15:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2021-04-01 07:15:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2021-04-01 07:15:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2021-04-01 07:15:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2021-04-01 07:15:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2021-04-01 07:15:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2021-04-01 07:15:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2021-04-01 07:15:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2021-04-01 07:15:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2021-04-01 07:15:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2021-04-01 07:15:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2021-04-01 07:15:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2021-04-01 07:15:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2021-04-01 07:15:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2021-04-01 07:15:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2021-04-01 07:15:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2021-04-01 07:15:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2021-04-01 07:15:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2021-04-01 07:15:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2021-04-01 07:15:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2021-04-01 07:15:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2021-04-01 07:15:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2021-04-01 07:15:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2021-04-01 07:15:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2021-04-01 07:15:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2021-04-01 07:15:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2021-04-01 07:15:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2021-04-01 07:15:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2021-04-01 07:15:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2021-04-01 07:16:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2021-04-01 07:16:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2021-04-01 07:16:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2021-04-01 07:16:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2021-04-01 07:16:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2021-04-01 07:16:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2021-04-01 07:16:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2021-04-01 07:16:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2021-04-01 07:16:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2021-04-01 07:16:01 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2021-04-01 07:16:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2021-04-01 07:16:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2021-04-01 07:16:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2021-04-01 07:16:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2021-04-01 07:16:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2021-04-01 07:16:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2021-04-01 07:16:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2021-04-01 07:16:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2021-04-01 07:16:02 [INFO    ] Setting Beam 2 xbars
2021-04-01 07:16:02 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2021-04-01 07:16:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2021-04-01 07:16:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2021-04-01 07:16:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2021-04-01 07:16:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2021-04-01 07:16:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2021-04-01 07:16:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2021-04-01 07:16:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2021-04-01 07:16:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2021-04-01 07:16:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2021-04-01 07:16:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2021-04-01 07:16:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2021-04-01 07:16:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2021-04-01 07:16:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2021-04-01 07:16:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2021-04-01 07:16:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2021-04-01 07:16:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2021-04-01 07:16:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2021-04-01 07:16:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2021-04-01 07:16:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2021-04-01 07:16:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2021-04-01 07:16:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2021-04-01 07:16:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2021-04-01 07:16:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2021-04-01 07:16:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2021-04-01 07:16:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2021-04-01 07:16:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2021-04-01 07:16:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2021-04-01 07:16:05 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2021-04-01 07:16:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2021-04-01 07:16:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2021-04-01 07:16:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2021-04-01 07:16:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2021-04-01 07:16:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2021-04-01 07:16:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2021-04-01 07:16:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2021-04-01 07:16:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2021-04-01 07:16:06 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2021-04-01 07:16:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2021-04-01 07:16:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2021-04-01 07:16:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2021-04-01 07:16:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2021-04-01 07:16:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2021-04-01 07:16:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2021-04-01 07:16:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2021-04-01 07:16:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2021-04-01 07:16:07 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2021-04-01 07:16:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2021-04-01 07:16:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2021-04-01 07:16:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2021-04-01 07:16:07 [INFO    ] Setting Beam 3 xbars
2021-04-01 07:16:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2021-04-01 07:16:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2021-04-01 07:16:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2021-04-01 07:16:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2021-04-01 07:16:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2021-04-01 07:16:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2021-04-01 07:16:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2021-04-01 07:16:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2021-04-01 07:16:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2021-04-01 07:16:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2021-04-01 07:16:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2021-04-01 07:16:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2021-04-01 07:16:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2021-04-01 07:16:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2021-04-01 07:16:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2021-04-01 07:16:09 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2021-04-01 07:16:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2021-04-01 07:16:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2021-04-01 07:16:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2021-04-01 07:16:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2021-04-01 07:16:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2021-04-01 07:16:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2021-04-01 07:16:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2021-04-01 07:16:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2021-04-01 07:16:10 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2021-04-01 07:16:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2021-04-01 07:16:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2021-04-01 07:16:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2021-04-01 07:16:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2021-04-01 07:16:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2021-04-01 07:16:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2021-04-01 07:16:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2021-04-01 07:16:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2021-04-01 07:16:11 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2021-04-01 07:16:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2021-04-01 07:16:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2021-04-01 07:16:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2021-04-01 07:16:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2021-04-01 07:16:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2021-04-01 07:16:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2021-04-01 07:16:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2021-04-01 07:16:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2021-04-01 07:16:12 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2021-04-01 07:16:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2021-04-01 07:16:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2021-04-01 07:16:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2021-04-01 07:16:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2021-04-01 07:16:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2021-04-01 07:16:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2021-04-01 07:16:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2021-04-01 07:16:12 [INFO    ] Setting Beam 4 xbars
2021-04-01 07:16:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2021-04-01 07:16:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2021-04-01 07:16:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2021-04-01 07:16:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2021-04-01 07:16:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2021-04-01 07:16:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2021-04-01 07:16:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2021-04-01 07:16:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2021-04-01 07:16:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2021-04-01 07:16:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2021-04-01 07:16:14 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2021-04-01 07:16:14 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2021-04-01 07:16:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2021-04-01 07:16:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2021-04-01 07:16:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2021-04-01 07:16:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2021-04-01 07:16:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2021-04-01 07:16:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2021-04-01 07:16:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2021-04-01 07:16:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2021-04-01 07:16:16 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2021-04-01 07:16:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2021-04-01 07:16:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2021-04-01 07:16:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2021-04-01 07:16:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2021-04-01 07:16:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2021-04-01 07:16:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2021-04-01 07:16:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2021-04-01 07:16:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2021-04-01 07:16:17 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2021-04-01 07:16:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2021-04-01 07:16:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2021-04-01 07:16:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2021-04-01 07:16:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2021-04-01 07:16:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2021-04-01 07:16:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2021-04-01 07:16:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2021-04-01 07:16:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2021-04-01 07:16:18 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2021-04-01 07:16:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2021-04-01 07:16:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2021-04-01 07:16:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2021-04-01 07:16:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2021-04-01 07:16:18 [INFO    ] All xbars set
2021-04-01 07:16:18 [INFO    ] Setting adder chain routing for all beams
2021-04-01 07:16:23 [INFO    ] Setting beam ids
2021-04-01 07:16:33 [INFO    ] Starting beam delay calibration
2021-04-01 07:16:45 [INFO    ] Beam 1 latency is 5736
2021-04-01 07:16:45 [INFO    ] Beam 2 latency is 5700
2021-04-01 07:16:45 [INFO    ] Beam 3 latency is 5717
2021-04-01 07:16:45 [INFO    ] Beam 4 latency is 5744
2021-04-01 07:16:45 [INFO    ] Stop calibration
2021-04-01 07:16:53 [INFO    ] Beam delay calibration successful
2021-04-01 07:16:53 [INFO    ] Calibration passed
2021-04-01 07:16:53 [DEBUG   ] spawn_process: at 2021-04-01 07:16:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2021-04-01 07:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2021-04-01 07:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2021-04-01 07:16:53 [DEBUG   ] spawn_process: at 2021-04-01 07:16:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2021-04-01 07:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2021-04-01 07:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2021-04-01 07:16:53 [DEBUG   ] spawn_process: at 2021-04-01 07:16:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2021-04-01 07:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2021-04-01 07:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2021-04-01 07:16:53 [DEBUG   ] spawn_process: at 2021-04-01 07:16:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2021-04-01 07:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2021-04-01 07:16:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2021-04-01 07:16:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2021-04-01 07:16:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 286 ms (1617261414.288 s) with PID 19999 and time 1617261415
2021-04-01 07:16:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2021-04-01 07:16:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 377 ms (1617261414.378 s) with PID 20002 and time 1617261415
2021-04-01 07:16:55 [DEBUG   ] Finished updating ant stats in 0.869 seconds
2021-04-01 07:16:55 [INFO    ] Started antennas statistics background thread
2021-04-01 07:16:55 [INFO    ] Started board flags background thread
2021-04-01 07:16:55 [INFO    ] Started BAM background thread
2021-04-01 07:16:55 [INFO    ] Finished the INI process (ref. #12693) in 104.701 s
2021-04-01 07:16:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:16:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:16:56 [DEBUG   ] Finished updating board flags in 1.053 seconds
2021-04-01 07:17:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 07:17:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:17:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:17:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 07:17:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:17:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:17:56 [DEBUG   ] Finished updating board flags in 1.009 seconds
2021-04-01 07:18:10 [DEBUG   ] Got command RPT from MCS: ref #12700
2021-04-01 07:18:10 [DEBUG   ] summary = ERROR
2021-04-01 07:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12700  13 59305 26290797 A  ERRORERROR'
2021-04-01 07:18:10 [DEBUG   ] Got command RPT from MCS: ref #12701
2021-04-01 07:18:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:18:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12701  77 59305 26290797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:18:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 07:18:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:18:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:18:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:18:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:18:56 [DEBUG   ] Finished updating board flags in 0.990 seconds
2021-04-01 07:19:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:19:20 [DEBUG   ] Got command RPT from MCS: ref #12708
2021-04-01 07:19:20 [DEBUG   ] summary = ERROR
2021-04-01 07:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12708  13 59305 26360477 A  ERRORERROR'
2021-04-01 07:19:20 [DEBUG   ] Got command RPT from MCS: ref #12709
2021-04-01 07:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12709  77 59305 26360477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:19:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:19:54 [DEBUG   ] Got command RPT from MCS: ref #12727
2021-04-01 07:19:54 [DEBUG   ] summary = ERROR
2021-04-01 07:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12727  13 59305 26394165 A  ERRORERROR'
2021-04-01 07:19:54 [DEBUG   ] Got command RPT from MCS: ref #12728
2021-04-01 07:19:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12728  77 59305 26394369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:19:54 [DEBUG   ] Got command RPT from MCS: ref #12729
2021-04-01 07:19:54 [DEBUG   ] summary = ERROR
2021-04-01 07:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12729  13 59305 26394573 A  ERRORERROR'
2021-04-01 07:19:54 [DEBUG   ] Got command RPT from MCS: ref #12730
2021-04-01 07:19:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12730  77 59305 26394765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:19:54 [DEBUG   ] Got command RPT from MCS: ref #12732
2021-04-01 07:19:54 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:19:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12732  12 59305 26394969 A  ERRORBš™š'
2021-04-01 07:19:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:19:56 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:19:56 [DEBUG   ] Finished updating board flags in 1.315 seconds
2021-04-01 07:20:15 [DEBUG   ] Finished updating ant stats in 0.512 seconds
2021-04-01 07:20:36 [DEBUG   ] Finished updating ant stats in 1.282 seconds
2021-04-01 07:20:56 [DEBUG   ] Finished updating ant stats in 1.232 seconds
2021-04-01 07:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:20:57 [DEBUG   ] Finished updating board flags in 1.734 seconds
2021-04-01 07:21:16 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2021-04-01 07:21:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:21:56 [DEBUG   ] Finished updating ant stats in 1.031 seconds
2021-04-01 07:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:21:57 [DEBUG   ] Finished updating board flags in 1.550 seconds
2021-04-01 07:22:16 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2021-04-01 07:22:36 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2021-04-01 07:22:56 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2021-04-01 07:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:22:57 [DEBUG   ] Finished updating board flags in 1.413 seconds
2021-04-01 07:23:16 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 07:23:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:23:56 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2021-04-01 07:23:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:23:57 [DEBUG   ] Finished updating board flags in 1.405 seconds
2021-04-01 07:24:16 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2021-04-01 07:24:20 [DEBUG   ] Got command RPT from MCS: ref #12743
2021-04-01 07:24:20 [DEBUG   ] summary = ERROR
2021-04-01 07:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12743  13 59305 26660477 A  ERRORERROR'
2021-04-01 07:24:20 [DEBUG   ] Got command RPT from MCS: ref #12744
2021-04-01 07:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12744  77 59305 26660477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:24:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:24:54 [DEBUG   ] Got command RPT from MCS: ref #12762
2021-04-01 07:24:54 [DEBUG   ] summary = ERROR
2021-04-01 07:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12762  13 59305 26694245 A  ERRORERROR'
2021-04-01 07:24:54 [DEBUG   ] Got command RPT from MCS: ref #12764
2021-04-01 07:24:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12764  77 59305 26694437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:24:54 [DEBUG   ] Got command RPT from MCS: ref #12766
2021-04-01 07:24:54 [DEBUG   ] summary = ERROR
2021-04-01 07:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12766  13 59305 26694641 A  ERRORERROR'
2021-04-01 07:24:54 [DEBUG   ] Got command RPT from MCS: ref #12768
2021-04-01 07:24:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:24:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12768  77 59305 26694845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:24:55 [DEBUG   ] Got command RPT from MCS: ref #12770
2021-04-01 07:24:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12770  12 59305 26695037 A  ERRORBš™š'
2021-04-01 07:24:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:24:57 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2021-04-01 07:24:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:24:57 [DEBUG   ] Finished updating board flags in 1.448 seconds
2021-04-01 07:25:17 [DEBUG   ] Finished updating ant stats in 1.309 seconds
2021-04-01 07:25:37 [DEBUG   ] Finished updating ant stats in 1.066 seconds
2021-04-01 07:25:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:25:57 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2021-04-01 07:25:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:25:57 [DEBUG   ] Finished updating board flags in 1.416 seconds
2021-04-01 07:26:17 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2021-04-01 07:26:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:26:57 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2021-04-01 07:26:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:26:57 [DEBUG   ] Finished updating board flags in 1.415 seconds
2021-04-01 07:27:17 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2021-04-01 07:27:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:27:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:27:57 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2021-04-01 07:27:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:27:57 [DEBUG   ] Finished updating board flags in 1.386 seconds
2021-04-01 07:28:17 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 07:28:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:28:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:28:57 [DEBUG   ] Finished updating ant stats in 0.426 seconds
2021-04-01 07:28:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:28:57 [DEBUG   ] Finished updating board flags in 1.208 seconds
2021-04-01 07:29:17 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2021-04-01 07:29:20 [DEBUG   ] Got command RPT from MCS: ref #12777
2021-04-01 07:29:20 [DEBUG   ] summary = ERROR
2021-04-01 07:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12777  13 59305 26960481 A  ERRORERROR'
2021-04-01 07:29:20 [DEBUG   ] Got command RPT from MCS: ref #12778
2021-04-01 07:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12778  77 59305 26960481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:29:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:29:54 [DEBUG   ] Got command RPT from MCS: ref #12796
2021-04-01 07:29:54 [DEBUG   ] summary = ERROR
2021-04-01 07:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12796  13 59305 26994309 A  ERRORERROR'
2021-04-01 07:29:54 [DEBUG   ] Got command RPT from MCS: ref #12797
2021-04-01 07:29:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12797  77 59305 26994513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:29:54 [DEBUG   ] Got command RPT from MCS: ref #12798
2021-04-01 07:29:54 [DEBUG   ] summary = ERROR
2021-04-01 07:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12798  13 59305 26994717 A  ERRORERROR'
2021-04-01 07:29:54 [DEBUG   ] Got command RPT from MCS: ref #12799
2021-04-01 07:29:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12799  77 59305 26994909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:29:55 [DEBUG   ] Got command RPT from MCS: ref #12801
2021-04-01 07:29:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12801  12 59305 26995113 A  ERRORB™™š'
2021-04-01 07:29:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:29:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:29:57 [DEBUG   ] Finished updating board flags in 1.174 seconds
2021-04-01 07:29:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:30:18 [DEBUG   ] Finished updating ant stats in 1.329 seconds
2021-04-01 07:30:38 [DEBUG   ] Finished updating ant stats in 1.074 seconds
2021-04-01 07:30:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:30:58 [DEBUG   ] Finished updating ant stats in 1.025 seconds
2021-04-01 07:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:30:58 [DEBUG   ] Finished updating board flags in 2.020 seconds
2021-04-01 07:31:18 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2021-04-01 07:31:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:31:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 07:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:31:58 [DEBUG   ] Finished updating board flags in 2.143 seconds
2021-04-01 07:32:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:32:33 [DEBUG   ] Got command DRX from MCS: ref #12817
2021-04-01 07:32:33 [INFO    ] sending drx command to lwa16
2021-04-01 07:32:33 [DEBUG   ] run_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 64500000.0 7 9 0']
2021-04-01 07:32:33 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 07:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    12817   8 59305 27153013 A  ERROR'
2021-04-01 07:32:33 [DEBUG   ] Got command DRX from MCS: ref #12816
2021-04-01 07:32:33 [INFO    ] sending drx command to lwa34
2021-04-01 07:32:33 [DEBUG   ] run_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2021-04-01 07:32:33 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 07:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    12816   8 59305 27153017 A  ERROR'
2021-04-01 07:32:33 [DEBUG   ] Got command DRX from MCS: ref #12819
2021-04-01 07:32:33 [INFO    ] sending drx command to lwa16
2021-04-01 07:32:33 [DEBUG   ] run_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 79200000.0 7 9 0']
2021-04-01 07:32:33 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 07:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    12819   8 59305 27153021 A  ERROR'
2021-04-01 07:32:33 [DEBUG   ] Got command DRX from MCS: ref #12818
2021-04-01 07:32:33 [INFO    ] sending drx command to lwa34
2021-04-01 07:32:33 [DEBUG   ] run_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2021-04-01 07:32:33 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 07:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    12818   8 59305 27153025 A  ERROR'
2021-04-01 07:32:33 [DEBUG   ] Got command BAM from MCS: ref #12820
2021-04-01 07:32:33 [INFO    ] Finished processing BAM request
2021-04-01 07:32:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12820   8 59305 27153029 A  ERROR'
2021-04-01 07:32:33 [DEBUG   ] Got command BAM from MCS: ref #12821
2021-04-01 07:32:33 [INFO    ] Finished processing BAM request
2021-04-01 07:32:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12821   8 59305 27153033 A  ERROR'
2021-04-01 07:32:33 [INFO    ] Finished starting DRX
2021-04-01 07:32:33 [INFO    ] Finished starting DRX
2021-04-01 07:32:33 [INFO    ] Finished starting DRX
2021-04-01 07:32:33 [INFO    ] Finished starting DRX
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 07:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 07:32:33 [DEBUG   ] spawn_process: at 2021-04-01 07:32:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 07:32:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:32:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:32:57 [DEBUG   ] Finished updating board flags in 1.302 seconds
2021-04-01 07:32:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:33:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:33:23 [DEBUG   ] Got command BAM from MCS: ref #12824
2021-04-01 07:33:23 [INFO    ] Finished processing BAM request
2021-04-01 07:33:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12824   8 59305 27203029 A  ERROR'
2021-04-01 07:33:23 [DEBUG   ] Got command BAM from MCS: ref #12825
2021-04-01 07:33:23 [INFO    ] Finished processing BAM request
2021-04-01 07:33:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12825   8 59305 27203033 A  ERROR'
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 07:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 07:33:23 [DEBUG   ] spawn_process: at 2021-04-01 07:33:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 07:33:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:33:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:33:57 [DEBUG   ] Finished updating board flags in 1.210 seconds
2021-04-01 07:33:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:34:13 [DEBUG   ] Got command BAM from MCS: ref #12833
2021-04-01 07:34:13 [INFO    ] Finished processing BAM request
2021-04-01 07:34:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12833   8 59305 27253029 A  ERROR'
2021-04-01 07:34:13 [DEBUG   ] Got command BAM from MCS: ref #12832
2021-04-01 07:34:13 [INFO    ] Finished processing BAM request
2021-04-01 07:34:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12832   8 59305 27253033 A  ERROR'
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 07:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 07:34:13 [DEBUG   ] spawn_process: at 2021-04-01 07:34:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 07:34:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:34:20 [DEBUG   ] Got command RPT from MCS: ref #12834
2021-04-01 07:34:20 [DEBUG   ] summary = ERROR
2021-04-01 07:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12834  13 59305 27260481 A  ERRORERROR'
2021-04-01 07:34:20 [DEBUG   ] Got command RPT from MCS: ref #12835
2021-04-01 07:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12835  77 59305 27260481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:34:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:34:54 [DEBUG   ] Got command RPT from MCS: ref #12851
2021-04-01 07:34:54 [DEBUG   ] summary = ERROR
2021-04-01 07:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12851  13 59305 27294385 A  ERRORERROR'
2021-04-01 07:34:54 [DEBUG   ] Got command RPT from MCS: ref #12852
2021-04-01 07:34:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12852  77 59305 27294589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:34:54 [DEBUG   ] Got command RPT from MCS: ref #12853
2021-04-01 07:34:54 [DEBUG   ] summary = ERROR
2021-04-01 07:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12853  13 59305 27294781 A  ERRORERROR'
2021-04-01 07:34:54 [DEBUG   ] Got command RPT from MCS: ref #12854
2021-04-01 07:34:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:34:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12854  77 59305 27294985 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:34:55 [DEBUG   ] Got command RPT from MCS: ref #12855
2021-04-01 07:34:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12855  12 59305 27295189 A  ERRORBžff'
2021-04-01 07:34:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 07:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:34:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:34:58 [DEBUG   ] Finished updating board flags in 1.746 seconds
2021-04-01 07:34:59 [DEBUG   ] Finished updating ant stats in 1.801 seconds
2021-04-01 07:35:03 [DEBUG   ] Got command BAM from MCS: ref #12857
2021-04-01 07:35:03 [INFO    ] Finished processing BAM request
2021-04-01 07:35:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12857   8 59305 27303033 A  ERROR'
2021-04-01 07:35:03 [DEBUG   ] Got command BAM from MCS: ref #12856
2021-04-01 07:35:03 [INFO    ] Finished processing BAM request
2021-04-01 07:35:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12856   8 59305 27303037 A  ERROR'
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 07:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 07:35:03 [DEBUG   ] spawn_process: at 2021-04-01 07:35:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 07:35:18 [DEBUG   ] Finished updating ant stats in 0.834 seconds
2021-04-01 07:35:38 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2021-04-01 07:35:53 [DEBUG   ] Got command BAM from MCS: ref #12859
2021-04-01 07:35:53 [INFO    ] Finished processing BAM request
2021-04-01 07:35:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:35:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12859   8 59305 27353029 A  ERROR'
2021-04-01 07:35:53 [DEBUG   ] Got command BAM from MCS: ref #12858
2021-04-01 07:35:53 [INFO    ] Finished processing BAM request
2021-04-01 07:35:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:35:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12858   8 59305 27353033 A  ERROR'
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 07:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 07:35:53 [DEBUG   ] spawn_process: at 2021-04-01 07:35:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 07:35:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:35:57 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:35:57 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:35:57 [DEBUG   ] Finished updating board flags in 1.022 seconds
2021-04-01 07:35:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:36:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:36:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:36:43 [DEBUG   ] Got command BAM from MCS: ref #12861
2021-04-01 07:36:43 [INFO    ] Finished processing BAM request
2021-04-01 07:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12861   8 59305 27403029 A  ERROR'
2021-04-01 07:36:43 [DEBUG   ] Got command BAM from MCS: ref #12860
2021-04-01 07:36:43 [INFO    ] Finished processing BAM request
2021-04-01 07:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12860   8 59305 27403033 A  ERROR'
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 07:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 07:36:43 [DEBUG   ] spawn_process: at 2021-04-01 07:36:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 07:36:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 07:36:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:36:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 07:36:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 07:36:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:36:58 [DEBUG   ] Finished updating board flags in 1.536 seconds
2021-04-01 07:37:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:37:33 [DEBUG   ] Got command BAM from MCS: ref #12869
2021-04-01 07:37:33 [INFO    ] Finished processing BAM request
2021-04-01 07:37:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12869   8 59305 27453025 A  ERROR'
2021-04-01 07:37:33 [DEBUG   ] Got command BAM from MCS: ref #12868
2021-04-01 07:37:33 [INFO    ] Finished processing BAM request
2021-04-01 07:37:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12868   8 59305 27453029 A  ERROR'
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 07:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 07:37:33 [DEBUG   ] spawn_process: at 2021-04-01 07:37:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 07:37:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 07:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 07:37:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:37:58 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2021-04-01 07:37:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 07:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 07:37:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:37:58 [DEBUG   ] Finished updating board flags in 1.470 seconds
2021-04-01 07:38:18 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2021-04-01 07:38:23 [DEBUG   ] Got command BAM from MCS: ref #12870
2021-04-01 07:38:23 [INFO    ] Finished processing BAM request
2021-04-01 07:38:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12870   8 59305 27503025 A  ERROR'
2021-04-01 07:38:23 [DEBUG   ] Got command BAM from MCS: ref #12871
2021-04-01 07:38:23 [INFO    ] Finished processing BAM request
2021-04-01 07:38:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12871   8 59305 27503029 A  ERROR'
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 07:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 07:38:23 [DEBUG   ] spawn_process: at 2021-04-01 07:38:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 07:38:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:38:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:38:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 07:38:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2021-04-01 07:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 07:38:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:38:59 [DEBUG   ] Finished updating board flags in 2.496 seconds
2021-04-01 07:39:13 [DEBUG   ] Got command BAM from MCS: ref #12873
2021-04-01 07:39:13 [INFO    ] Finished processing BAM request
2021-04-01 07:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12873   8 59305 27553029 A  ERROR'
2021-04-01 07:39:13 [DEBUG   ] Got command BAM from MCS: ref #12872
2021-04-01 07:39:13 [INFO    ] Finished processing BAM request
2021-04-01 07:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12872   8 59305 27553033 A  ERROR'
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 07:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 07:39:13 [DEBUG   ] spawn_process: at 2021-04-01 07:39:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 07:39:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:39:20 [DEBUG   ] Got command RPT from MCS: ref #12874
2021-04-01 07:39:20 [DEBUG   ] summary = ERROR
2021-04-01 07:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12874  13 59305 27560481 A  ERRORERROR'
2021-04-01 07:39:20 [DEBUG   ] Got command RPT from MCS: ref #12875
2021-04-01 07:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12875  77 59305 27560481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:39:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:39:54 [DEBUG   ] Got command RPT from MCS: ref #12895
2021-04-01 07:39:54 [DEBUG   ] summary = ERROR
2021-04-01 07:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12895  13 59305 27594453 A  ERRORERROR'
2021-04-01 07:39:54 [DEBUG   ] Got command RPT from MCS: ref #12897
2021-04-01 07:39:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12897  77 59305 27594657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:39:54 [DEBUG   ] Got command RPT from MCS: ref #12899
2021-04-01 07:39:54 [DEBUG   ] summary = ERROR
2021-04-01 07:39:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12899  13 59305 27594861 A  ERRORERROR'
2021-04-01 07:39:55 [DEBUG   ] Got command RPT from MCS: ref #12901
2021-04-01 07:39:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12901  77 59305 27595053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:39:55 [DEBUG   ] Got command RPT from MCS: ref #12904
2021-04-01 07:39:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12904  12 59305 27595257 A  ERRORB¢ff'
2021-04-01 07:39:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 07:39:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:39:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 07:39:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:39:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:39:58 [DEBUG   ] Finished updating board flags in 1.270 seconds
2021-04-01 07:39:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:40:03 [DEBUG   ] Got command BAM from MCS: ref #12910
2021-04-01 07:40:03 [INFO    ] Finished processing BAM request
2021-04-01 07:40:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12910   8 59305 27603029 A  ERROR'
2021-04-01 07:40:03 [DEBUG   ] Got command BAM from MCS: ref #12909
2021-04-01 07:40:03 [INFO    ] Finished processing BAM request
2021-04-01 07:40:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12909   8 59305 27603033 A  ERROR'
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 07:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 07:40:03 [DEBUG   ] spawn_process: at 2021-04-01 07:40:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 07:40:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:40:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:40:53 [DEBUG   ] Got command BAM from MCS: ref #12912
2021-04-01 07:40:53 [INFO    ] Finished processing BAM request
2021-04-01 07:40:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12912   8 59305 27653033 A  ERROR'
2021-04-01 07:40:53 [DEBUG   ] Got command BAM from MCS: ref #12911
2021-04-01 07:40:53 [INFO    ] Finished processing BAM request
2021-04-01 07:40:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12911   8 59305 27653037 A  ERROR'
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 07:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 07:40:53 [DEBUG   ] spawn_process: at 2021-04-01 07:40:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 07:40:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:40:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 07:40:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:40:58 [DEBUG   ] Finished updating board flags in 1.179 seconds
2021-04-01 07:40:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 07:41:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 07:41:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:41:43 [DEBUG   ] Got command BAM from MCS: ref #12914
2021-04-01 07:41:43 [INFO    ] Finished processing BAM request
2021-04-01 07:41:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12914   8 59305 27703033 A  ERROR'
2021-04-01 07:41:43 [DEBUG   ] Got command BAM from MCS: ref #12913
2021-04-01 07:41:43 [INFO    ] Finished processing BAM request
2021-04-01 07:41:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12913   8 59305 27703037 A  ERROR'
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 07:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 07:41:43 [DEBUG   ] spawn_process: at 2021-04-01 07:41:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 07:41:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 07:41:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:41:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:41:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:41:58 [DEBUG   ] Finished updating board flags in 1.051 seconds
2021-04-01 07:41:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:42:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:42:33 [DEBUG   ] Got command BAM from MCS: ref #12915
2021-04-01 07:42:33 [INFO    ] Finished processing BAM request
2021-04-01 07:42:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12915   8 59305 27753029 A  ERROR'
2021-04-01 07:42:33 [DEBUG   ] Got command BAM from MCS: ref #12916
2021-04-01 07:42:33 [INFO    ] Finished processing BAM request
2021-04-01 07:42:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12916   8 59305 27753033 A  ERROR'
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 07:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 07:42:33 [DEBUG   ] spawn_process: at 2021-04-01 07:42:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 07:42:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 07:42:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 07:42:59 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2021-04-01 07:42:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 07:42:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 07:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:42:59 [DEBUG   ] Finished updating board flags in 2.014 seconds
2021-04-01 07:43:19 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 07:43:23 [DEBUG   ] Got command BAM from MCS: ref #12923
2021-04-01 07:43:23 [INFO    ] Finished processing BAM request
2021-04-01 07:43:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12923   8 59305 27803033 A  ERROR'
2021-04-01 07:43:23 [DEBUG   ] Got command BAM from MCS: ref #12924
2021-04-01 07:43:23 [INFO    ] Finished processing BAM request
2021-04-01 07:43:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12924   8 59305 27803037 A  ERROR'
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 07:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 07:43:23 [DEBUG   ] spawn_process: at 2021-04-01 07:43:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 07:43:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2021-04-01 07:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 07:43:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 07:43:58 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 07:43:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 07:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:43:58 [DEBUG   ] Finished updating board flags in 1.440 seconds
2021-04-01 07:43:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:44:13 [DEBUG   ] Got command BAM from MCS: ref #12925
2021-04-01 07:44:13 [INFO    ] Finished processing BAM request
2021-04-01 07:44:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12925   8 59305 27853025 A  ERROR'
2021-04-01 07:44:13 [DEBUG   ] Got command BAM from MCS: ref #12926
2021-04-01 07:44:13 [INFO    ] Finished processing BAM request
2021-04-01 07:44:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12926   8 59305 27853029 A  ERROR'
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 07:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 07:44:13 [DEBUG   ] spawn_process: at 2021-04-01 07:44:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 07:44:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:44:20 [DEBUG   ] Got command RPT from MCS: ref #12927
2021-04-01 07:44:20 [DEBUG   ] summary = ERROR
2021-04-01 07:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12927  13 59305 27860477 A  ERRORERROR'
2021-04-01 07:44:20 [DEBUG   ] Got command RPT from MCS: ref #12928
2021-04-01 07:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12928  77 59305 27860477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:44:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:44:54 [DEBUG   ] Got command RPT from MCS: ref #12944
2021-04-01 07:44:54 [DEBUG   ] summary = ERROR
2021-04-01 07:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12944  13 59305 27894529 A  ERRORERROR'
2021-04-01 07:44:54 [DEBUG   ] Got command RPT from MCS: ref #12945
2021-04-01 07:44:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12945  77 59305 27894733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:44:54 [DEBUG   ] Got command RPT from MCS: ref #12946
2021-04-01 07:44:54 [DEBUG   ] summary = ERROR
2021-04-01 07:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12946  13 59305 27894925 A  ERRORERROR'
2021-04-01 07:44:55 [DEBUG   ] Got command RPT from MCS: ref #12947
2021-04-01 07:44:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12947  77 59305 27895129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:44:55 [DEBUG   ] Got command RPT from MCS: ref #12948
2021-04-01 07:44:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12948  12 59305 27895333 A  ERRORB¥ff'
2021-04-01 07:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 07:44:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:44:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:44:58 [DEBUG   ] Finished updating board flags in 1.346 seconds
2021-04-01 07:44:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:45:03 [DEBUG   ] Got command BAM from MCS: ref #12950
2021-04-01 07:45:03 [INFO    ] Finished processing BAM request
2021-04-01 07:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12950   8 59305 27903029 A  ERROR'
2021-04-01 07:45:03 [DEBUG   ] Got command BAM from MCS: ref #12949
2021-04-01 07:45:03 [INFO    ] Finished processing BAM request
2021-04-01 07:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12949   8 59305 27903033 A  ERROR'
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 07:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 07:45:03 [DEBUG   ] spawn_process: at 2021-04-01 07:45:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 07:45:19 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 07:45:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:45:53 [DEBUG   ] Got command BAM from MCS: ref #12951
2021-04-01 07:45:53 [INFO    ] Finished processing BAM request
2021-04-01 07:45:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:45:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12951   8 59305 27953033 A  ERROR'
2021-04-01 07:45:53 [DEBUG   ] Got command BAM from MCS: ref #12952
2021-04-01 07:45:53 [INFO    ] Finished processing BAM request
2021-04-01 07:45:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:45:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12952   8 59305 27953037 A  ERROR'
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 07:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 07:45:53 [DEBUG   ] spawn_process: at 2021-04-01 07:45:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 07:45:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 07:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:45:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:45:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 07:45:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:45:58 [DEBUG   ] Finished updating board flags in 1.179 seconds
2021-04-01 07:46:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:46:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:46:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:46:43 [DEBUG   ] Got command BAM from MCS: ref #12960
2021-04-01 07:46:43 [INFO    ] Finished processing BAM request
2021-04-01 07:46:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12960   8 59305 28003025 A  ERROR'
2021-04-01 07:46:43 [DEBUG   ] Got command BAM from MCS: ref #12959
2021-04-01 07:46:43 [INFO    ] Finished processing BAM request
2021-04-01 07:46:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12959   8 59305 28003029 A  ERROR'
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 07:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 07:46:43 [DEBUG   ] spawn_process: at 2021-04-01 07:46:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 07:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2021-04-01 07:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 07:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:46:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 07:46:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:46:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 07:46:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:46:58 [DEBUG   ] Finished updating board flags in 1.041 seconds
2021-04-01 07:47:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:47:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:47:33 [DEBUG   ] Got command BAM from MCS: ref #12961
2021-04-01 07:47:33 [INFO    ] Finished processing BAM request
2021-04-01 07:47:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12961   8 59305 28053033 A  ERROR'
2021-04-01 07:47:33 [DEBUG   ] Got command BAM from MCS: ref #12962
2021-04-01 07:47:33 [INFO    ] Finished processing BAM request
2021-04-01 07:47:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12962   8 59305 28053037 A  ERROR'
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 07:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 07:47:33 [DEBUG   ] spawn_process: at 2021-04-01 07:47:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 07:47:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:47:58 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 07:47:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:47:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 07:47:58 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:47:58 [DEBUG   ] Finished updating board flags in 0.981 seconds
2021-04-01 07:48:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:48:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:48:23 [DEBUG   ] Got command BAM from MCS: ref #12963
2021-04-01 07:48:23 [INFO    ] Finished processing BAM request
2021-04-01 07:48:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12963   8 59305 28103029 A  ERROR'
2021-04-01 07:48:23 [DEBUG   ] Got command BAM from MCS: ref #12964
2021-04-01 07:48:23 [INFO    ] Finished processing BAM request
2021-04-01 07:48:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12964   8 59305 28103033 A  ERROR'
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 07:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 07:48:23 [DEBUG   ] spawn_process: at 2021-04-01 07:48:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 07:48:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:48:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 07:48:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:48:59 [DEBUG   ] Finished updating board flags in 1.384 seconds
2021-04-01 07:49:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:49:13 [DEBUG   ] Got command BAM from MCS: ref #12971
2021-04-01 07:49:13 [INFO    ] Finished processing BAM request
2021-04-01 07:49:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:49:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12971   8 59305 28153033 A  ERROR'
2021-04-01 07:49:13 [DEBUG   ] Got command BAM from MCS: ref #12972
2021-04-01 07:49:13 [INFO    ] Finished processing BAM request
2021-04-01 07:49:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:49:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    12972   8 59305 28153037 A  ERROR'
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 07:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 07:49:13 [DEBUG   ] spawn_process: at 2021-04-01 07:49:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 07:49:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 07:49:20 [DEBUG   ] Got command RPT from MCS: ref #12973
2021-04-01 07:49:20 [DEBUG   ] summary = ERROR
2021-04-01 07:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12973  13 59305 28160477 A  ERRORERROR'
2021-04-01 07:49:20 [DEBUG   ] Got command RPT from MCS: ref #12974
2021-04-01 07:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12974  77 59305 28160477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:49:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:49:54 [DEBUG   ] Got command RPT from MCS: ref #12992
2021-04-01 07:49:54 [DEBUG   ] summary = ERROR
2021-04-01 07:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12992  13 59305 28194597 A  ERRORERROR'
2021-04-01 07:49:54 [DEBUG   ] Got command RPT from MCS: ref #12993
2021-04-01 07:49:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12993  77 59305 28194801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:49:55 [DEBUG   ] Got command RPT from MCS: ref #12994
2021-04-01 07:49:55 [DEBUG   ] summary = ERROR
2021-04-01 07:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12994  13 59305 28195005 A  ERRORERROR'
2021-04-01 07:49:55 [DEBUG   ] Got command RPT from MCS: ref #12995
2021-04-01 07:49:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12995  77 59305 28195197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:49:55 [DEBUG   ] Got command RPT from MCS: ref #12997
2021-04-01 07:49:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12997  12 59305 28195401 A  ERRORB¥ff'
2021-04-01 07:49:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 07:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:49:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 07:49:59 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 07:49:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:49:59 [DEBUG   ] Finished updating board flags in 1.191 seconds
2021-04-01 07:50:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 07:50:03 [DEBUG   ] Got command BAM from MCS: ref #13002
2021-04-01 07:50:03 [INFO    ] Finished processing BAM request
2021-04-01 07:50:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13002   8 59305 28203025 A  ERROR'
2021-04-01 07:50:03 [DEBUG   ] Got command BAM from MCS: ref #13003
2021-04-01 07:50:03 [INFO    ] Finished processing BAM request
2021-04-01 07:50:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13003   8 59305 28203029 A  ERROR'
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 07:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 07:50:03 [DEBUG   ] spawn_process: at 2021-04-01 07:50:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 07:50:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:50:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:50:53 [DEBUG   ] Got command BAM from MCS: ref #13005
2021-04-01 07:50:53 [INFO    ] Finished processing BAM request
2021-04-01 07:50:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:50:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13005   8 59305 28253033 A  ERROR'
2021-04-01 07:50:53 [DEBUG   ] Got command BAM from MCS: ref #13004
2021-04-01 07:50:53 [INFO    ] Finished processing BAM request
2021-04-01 07:50:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:50:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13004   8 59305 28253037 A  ERROR'
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 07:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 07:50:53 [DEBUG   ] spawn_process: at 2021-04-01 07:50:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 07:50:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 07:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:51:00 [DEBUG   ] Finished updating ant stats in 1.030 seconds
2021-04-01 07:51:00 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 07:51:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 07:51:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:51:00 [DEBUG   ] Finished updating board flags in 2.045 seconds
2021-04-01 07:51:20 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2021-04-01 07:51:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 07:51:43 [DEBUG   ] Got command BAM from MCS: ref #13007
2021-04-01 07:51:43 [INFO    ] Finished processing BAM request
2021-04-01 07:51:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13007   8 59305 28303025 A  ERROR'
2021-04-01 07:51:43 [DEBUG   ] Got command BAM from MCS: ref #13006
2021-04-01 07:51:43 [INFO    ] Finished processing BAM request
2021-04-01 07:51:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13006   8 59305 28303029 A  ERROR'
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 07:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 07:51:43 [DEBUG   ] spawn_process: at 2021-04-01 07:51:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 07:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 07:52:00 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2021-04-01 07:52:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:52:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:52:00 [DEBUG   ] Finished updating board flags in 1.976 seconds
2021-04-01 07:52:20 [DEBUG   ] Finished updating ant stats in 0.778 seconds
2021-04-01 07:52:33 [DEBUG   ] Got command BAM from MCS: ref #13014
2021-04-01 07:52:33 [INFO    ] Finished processing BAM request
2021-04-01 07:52:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13014   8 59305 28353029 A  ERROR'
2021-04-01 07:52:33 [DEBUG   ] Got command BAM from MCS: ref #13015
2021-04-01 07:52:33 [INFO    ] Finished processing BAM request
2021-04-01 07:52:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13015   8 59305 28353033 A  ERROR'
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 07:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 07:52:33 [DEBUG   ] spawn_process: at 2021-04-01 07:52:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 07:52:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 07:52:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 07:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:53:00 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2021-04-01 07:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 07:53:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:53:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:53:00 [DEBUG   ] Finished updating board flags in 1.818 seconds
2021-04-01 07:53:20 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 07:53:23 [DEBUG   ] Got command BAM from MCS: ref #13017
2021-04-01 07:53:23 [INFO    ] Finished processing BAM request
2021-04-01 07:53:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13017   8 59305 28403025 A  ERROR'
2021-04-01 07:53:23 [DEBUG   ] Got command BAM from MCS: ref #13016
2021-04-01 07:53:23 [INFO    ] Finished processing BAM request
2021-04-01 07:53:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13016   8 59305 28403029 A  ERROR'
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 07:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 07:53:23 [DEBUG   ] spawn_process: at 2021-04-01 07:53:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 07:53:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 07:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 07:53:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:53:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:53:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 07:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:53:59 [DEBUG   ] Finished updating board flags in 1.251 seconds
2021-04-01 07:54:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:54:13 [DEBUG   ] Got command BAM from MCS: ref #13019
2021-04-01 07:54:13 [INFO    ] Finished processing BAM request
2021-04-01 07:54:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13019   8 59305 28453029 A  ERROR'
2021-04-01 07:54:13 [DEBUG   ] Got command BAM from MCS: ref #13018
2021-04-01 07:54:13 [INFO    ] Finished processing BAM request
2021-04-01 07:54:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13018   8 59305 28453033 A  ERROR'
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 07:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 07:54:13 [DEBUG   ] spawn_process: at 2021-04-01 07:54:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 07:54:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:54:20 [DEBUG   ] Got command RPT from MCS: ref #13020
2021-04-01 07:54:20 [DEBUG   ] summary = ERROR
2021-04-01 07:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13020  13 59305 28460485 A  ERRORERROR'
2021-04-01 07:54:20 [DEBUG   ] Got command RPT from MCS: ref #13021
2021-04-01 07:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13021  77 59305 28460485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:54:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 07:54:54 [DEBUG   ] Got command RPT from MCS: ref #13039
2021-04-01 07:54:54 [DEBUG   ] summary = ERROR
2021-04-01 07:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13039  13 59305 28494677 A  ERRORERROR'
2021-04-01 07:54:54 [DEBUG   ] Got command RPT from MCS: ref #13041
2021-04-01 07:54:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:54:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13041  77 59305 28494869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:54:55 [DEBUG   ] Got command RPT from MCS: ref #13043
2021-04-01 07:54:55 [DEBUG   ] summary = ERROR
2021-04-01 07:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13043  13 59305 28495073 A  ERRORERROR'
2021-04-01 07:54:55 [DEBUG   ] Got command RPT from MCS: ref #13045
2021-04-01 07:54:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13045  77 59305 28495277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:54:55 [DEBUG   ] Got command RPT from MCS: ref #13047
2021-04-01 07:54:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13047  12 59305 28495469 A  ERRORB¤ff'
2021-04-01 07:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 07:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:54:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:54:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:54:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 07:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 07:55:00 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-04-01 07:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:55:00 [DEBUG   ] Finished updating board flags in 1.547 seconds
2021-04-01 07:55:03 [DEBUG   ] Got command BAM from MCS: ref #13049
2021-04-01 07:55:03 [INFO    ] Finished processing BAM request
2021-04-01 07:55:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13049   8 59305 28503025 A  ERROR'
2021-04-01 07:55:03 [DEBUG   ] Got command BAM from MCS: ref #13048
2021-04-01 07:55:03 [INFO    ] Finished processing BAM request
2021-04-01 07:55:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13048   8 59305 28503029 A  ERROR'
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 07:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 07:55:03 [DEBUG   ] spawn_process: at 2021-04-01 07:55:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 07:55:20 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 07:55:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:55:53 [DEBUG   ] Got command BAM from MCS: ref #13051
2021-04-01 07:55:53 [INFO    ] Finished processing BAM request
2021-04-01 07:55:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:55:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13051   8 59305 28553025 A  ERROR'
2021-04-01 07:55:53 [DEBUG   ] Got command BAM from MCS: ref #13050
2021-04-01 07:55:53 [INFO    ] Finished processing BAM request
2021-04-01 07:55:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:55:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13050   8 59305 28553029 A  ERROR'
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 07:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 07:55:53 [DEBUG   ] spawn_process: at 2021-04-01 07:55:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 07:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:55:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 07:55:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:55:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 07:55:59 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:55:59 [DEBUG   ] Finished updating board flags in 0.984 seconds
2021-04-01 07:56:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:56:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:56:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:56:43 [DEBUG   ] Got command BAM from MCS: ref #13052
2021-04-01 07:56:43 [INFO    ] Finished processing BAM request
2021-04-01 07:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13052   8 59305 28603029 A  ERROR'
2021-04-01 07:56:43 [DEBUG   ] Got command BAM from MCS: ref #13053
2021-04-01 07:56:43 [INFO    ] Finished processing BAM request
2021-04-01 07:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13053   8 59305 28603033 A  ERROR'
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 07:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 07:56:43 [DEBUG   ] spawn_process: at 2021-04-01 07:56:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 07:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 07:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:57:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 07:57:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:57:00 [DEBUG   ] Finished updating board flags in 1.416 seconds
2021-04-01 07:57:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:57:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:57:33 [DEBUG   ] Got command BAM from MCS: ref #13054
2021-04-01 07:57:33 [INFO    ] Finished processing BAM request
2021-04-01 07:57:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13054   8 59305 28653025 A  ERROR'
2021-04-01 07:57:33 [DEBUG   ] Got command BAM from MCS: ref #13055
2021-04-01 07:57:33 [INFO    ] Finished processing BAM request
2021-04-01 07:57:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13055   8 59305 28653029 A  ERROR'
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 07:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 07:57:33 [DEBUG   ] spawn_process: at 2021-04-01 07:57:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 07:57:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:58:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:58:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:58:00 [DEBUG   ] Finished updating board flags in 1.432 seconds
2021-04-01 07:58:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:58:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 07:58:23 [DEBUG   ] Got command BAM from MCS: ref #13062
2021-04-01 07:58:23 [INFO    ] Finished processing BAM request
2021-04-01 07:58:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13062   8 59305 28703033 A  ERROR'
2021-04-01 07:58:23 [DEBUG   ] Got command BAM from MCS: ref #13063
2021-04-01 07:58:23 [INFO    ] Finished processing BAM request
2021-04-01 07:58:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13063   8 59305 28703037 A  ERROR'
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 07:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 07:58:23 [DEBUG   ] spawn_process: at 2021-04-01 07:58:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 07:58:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 07:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:59:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 07:59:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 07:59:00 [DEBUG   ] Finished updating board flags in 1.344 seconds
2021-04-01 07:59:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:59:13 [DEBUG   ] Got command BAM from MCS: ref #13064
2021-04-01 07:59:13 [INFO    ] Finished processing BAM request
2021-04-01 07:59:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13064   8 59305 28753029 A  ERROR'
2021-04-01 07:59:13 [DEBUG   ] Got command BAM from MCS: ref #13065
2021-04-01 07:59:13 [INFO    ] Finished processing BAM request
2021-04-01 07:59:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 07:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13065   8 59305 28753033 A  ERROR'
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 07:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 07:59:13 [DEBUG   ] spawn_process: at 2021-04-01 07:59:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 07:59:20 [DEBUG   ] Got command RPT from MCS: ref #13066
2021-04-01 07:59:20 [DEBUG   ] summary = ERROR
2021-04-01 07:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13066  13 59305 28760485 A  ERRORERROR'
2021-04-01 07:59:20 [DEBUG   ] Got command RPT from MCS: ref #13067
2021-04-01 07:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13067  77 59305 28760485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:59:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:59:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 07:59:54 [DEBUG   ] Got command RPT from MCS: ref #13085
2021-04-01 07:59:54 [DEBUG   ] summary = ERROR
2021-04-01 07:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13085  13 59305 28794745 A  ERRORERROR'
2021-04-01 07:59:54 [DEBUG   ] Got command RPT from MCS: ref #13086
2021-04-01 07:59:54 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13086  77 59305 28794949 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:59:55 [DEBUG   ] Got command RPT from MCS: ref #13087
2021-04-01 07:59:55 [DEBUG   ] summary = ERROR
2021-04-01 07:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13087  13 59305 28795141 A  ERRORERROR'
2021-04-01 07:59:55 [DEBUG   ] Got command RPT from MCS: ref #13088
2021-04-01 07:59:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 07:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13088  77 59305 28795345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 07:59:55 [DEBUG   ] Got command RPT from MCS: ref #13090
2021-04-01 07:59:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 07:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13090  12 59305 28795549 A  ERRORB¤ff'
2021-04-01 07:59:59 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 07:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 07:59:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2021-04-01 08:00:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:00:00 [DEBUG   ] Finished updating board flags in 1.223 seconds
2021-04-01 08:00:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:00:03 [DEBUG   ] Got command BAM from MCS: ref #13096
2021-04-01 08:00:03 [INFO    ] Finished processing BAM request
2021-04-01 08:00:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13096   8 59305 28803033 A  ERROR'
2021-04-01 08:00:03 [DEBUG   ] Got command BAM from MCS: ref #13095
2021-04-01 08:00:03 [INFO    ] Finished processing BAM request
2021-04-01 08:00:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13095   8 59305 28803037 A  ERROR'
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:00:03 [DEBUG   ] spawn_process: at 2021-04-01 08:00:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:00:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:00:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:00:53 [DEBUG   ] Got command BAM from MCS: ref #13098
2021-04-01 08:00:53 [INFO    ] Finished processing BAM request
2021-04-01 08:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13098   8 59305 28853029 A  ERROR'
2021-04-01 08:00:53 [DEBUG   ] Got command BAM from MCS: ref #13097
2021-04-01 08:00:53 [INFO    ] Finished processing BAM request
2021-04-01 08:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13097   8 59305 28853033 A  ERROR'
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:00:53 [DEBUG   ] spawn_process: at 2021-04-01 08:00:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:00:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:01:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:01:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:01:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:01:00 [DEBUG   ] Finished updating board flags in 1.163 seconds
2021-04-01 08:01:02 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2021-04-01 08:01:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:01:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:01:43 [DEBUG   ] Got command BAM from MCS: ref #13105
2021-04-01 08:01:43 [INFO    ] Finished processing BAM request
2021-04-01 08:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13105   8 59305 28903025 A  ERROR'
2021-04-01 08:01:43 [DEBUG   ] Got command BAM from MCS: ref #13106
2021-04-01 08:01:43 [INFO    ] Finished processing BAM request
2021-04-01 08:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13106   8 59305 28903029 A  ERROR'
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:01:43 [DEBUG   ] spawn_process: at 2021-04-01 08:01:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:01:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 08:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:02:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:02:00 [DEBUG   ] Finished updating board flags in 1.044 seconds
2021-04-01 08:02:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:02:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:02:33 [DEBUG   ] Got command BAM from MCS: ref #13108
2021-04-01 08:02:33 [INFO    ] Finished processing BAM request
2021-04-01 08:02:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13108   8 59305 28953025 A  ERROR'
2021-04-01 08:02:33 [DEBUG   ] Got command BAM from MCS: ref #13107
2021-04-01 08:02:33 [INFO    ] Finished processing BAM request
2021-04-01 08:02:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13107   8 59305 28953029 A  ERROR'
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:02:33 [DEBUG   ] spawn_process: at 2021-04-01 08:02:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:02:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:03:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 08:03:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:03:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:03:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:03:02 [DEBUG   ] Finished updating board flags in 3.129 seconds
2021-04-01 08:03:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 08:03:23 [DEBUG   ] Got command BAM from MCS: ref #13110
2021-04-01 08:03:23 [INFO    ] Finished processing BAM request
2021-04-01 08:03:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13110   8 59305 29003033 A  ERROR'
2021-04-01 08:03:23 [DEBUG   ] Got command BAM from MCS: ref #13109
2021-04-01 08:03:23 [INFO    ] Finished processing BAM request
2021-04-01 08:03:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13109   8 59305 29003037 A  ERROR'
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:03:23 [DEBUG   ] spawn_process: at 2021-04-01 08:03:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:03:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:04:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-04-01 08:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:04:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:04:01 [DEBUG   ] Finished updating board flags in 1.878 seconds
2021-04-01 08:04:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:04:13 [DEBUG   ] Got command BAM from MCS: ref #13118
2021-04-01 08:04:13 [INFO    ] Finished processing BAM request
2021-04-01 08:04:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13118   8 59305 29053025 A  ERROR'
2021-04-01 08:04:13 [DEBUG   ] Got command BAM from MCS: ref #13117
2021-04-01 08:04:13 [INFO    ] Finished processing BAM request
2021-04-01 08:04:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13117   8 59305 29053029 A  ERROR'
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:04:13 [DEBUG   ] spawn_process: at 2021-04-01 08:04:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:04:20 [DEBUG   ] Got command RPT from MCS: ref #13119
2021-04-01 08:04:20 [DEBUG   ] summary = ERROR
2021-04-01 08:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13119  13 59305 29060489 A  ERRORERROR'
2021-04-01 08:04:20 [DEBUG   ] Got command RPT from MCS: ref #13120
2021-04-01 08:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13120  77 59305 29060489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:04:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:04:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:04:54 [DEBUG   ] Got command RPT from MCS: ref #13136
2021-04-01 08:04:54 [DEBUG   ] summary = ERROR
2021-04-01 08:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13136  13 59305 29094813 A  ERRORERROR'
2021-04-01 08:04:55 [DEBUG   ] Got command RPT from MCS: ref #13137
2021-04-01 08:04:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13137  77 59305 29095017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:04:55 [DEBUG   ] Got command RPT from MCS: ref #13138
2021-04-01 08:04:55 [DEBUG   ] summary = ERROR
2021-04-01 08:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13138  13 59305 29095221 A  ERRORERROR'
2021-04-01 08:04:55 [DEBUG   ] Got command RPT from MCS: ref #13139
2021-04-01 08:04:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13139  77 59305 29095425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:04:55 [DEBUG   ] Got command RPT from MCS: ref #13140
2021-04-01 08:04:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13140  12 59305 29095617 A  ERRORB£ff'
2021-04-01 08:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:05:00 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:05:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:05:00 [DEBUG   ] Finished updating board flags in 1.199 seconds
2021-04-01 08:05:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:05:03 [DEBUG   ] Got command BAM from MCS: ref #13141
2021-04-01 08:05:03 [INFO    ] Finished processing BAM request
2021-04-01 08:05:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13141   8 59305 29103025 A  ERROR'
2021-04-01 08:05:03 [DEBUG   ] Got command BAM from MCS: ref #13142
2021-04-01 08:05:03 [INFO    ] Finished processing BAM request
2021-04-01 08:05:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13142   8 59305 29103029 A  ERROR'
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:05:03 [DEBUG   ] spawn_process: at 2021-04-01 08:05:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:05:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:05:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:05:53 [DEBUG   ] Got command BAM from MCS: ref #13144
2021-04-01 08:05:53 [INFO    ] Finished processing BAM request
2021-04-01 08:05:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:05:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13144   8 59305 29153025 A  ERROR'
2021-04-01 08:05:53 [DEBUG   ] Got command BAM from MCS: ref #13143
2021-04-01 08:05:53 [INFO    ] Finished processing BAM request
2021-04-01 08:05:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:05:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13143   8 59305 29153029 A  ERROR'
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:05:53 [DEBUG   ] spawn_process: at 2021-04-01 08:05:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:06:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:06:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:06:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:06:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:06:00 [DEBUG   ] Finished updating board flags in 1.014 seconds
2021-04-01 08:06:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:06:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:06:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:06:43 [DEBUG   ] Got command BAM from MCS: ref #13146
2021-04-01 08:06:43 [INFO    ] Finished processing BAM request
2021-04-01 08:06:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13146   8 59305 29203025 A  ERROR'
2021-04-01 08:06:43 [DEBUG   ] Got command BAM from MCS: ref #13145
2021-04-01 08:06:43 [INFO    ] Finished processing BAM request
2021-04-01 08:06:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13145   8 59305 29203029 A  ERROR'
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:06:43 [DEBUG   ] spawn_process: at 2021-04-01 08:06:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:07:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2021-04-01 08:07:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:07:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:07:00 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:07:00 [DEBUG   ] Finished updating board flags in 1.064 seconds
2021-04-01 08:07:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:07:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:07:33 [DEBUG   ] Got command BAM from MCS: ref #13154
2021-04-01 08:07:33 [INFO    ] Finished processing BAM request
2021-04-01 08:07:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13154   8 59305 29253033 A  ERROR'
2021-04-01 08:07:33 [DEBUG   ] Got command BAM from MCS: ref #13153
2021-04-01 08:07:33 [INFO    ] Finished processing BAM request
2021-04-01 08:07:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13153   8 59305 29253037 A  ERROR'
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:07:33 [DEBUG   ] spawn_process: at 2021-04-01 08:07:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:07:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:08:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:08:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:08:01 [DEBUG   ] Finished updating board flags in 1.533 seconds
2021-04-01 08:08:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 08:08:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:08:23 [DEBUG   ] Got command BAM from MCS: ref #13156
2021-04-01 08:08:23 [INFO    ] Finished processing BAM request
2021-04-01 08:08:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13156   8 59305 29303025 A  ERROR'
2021-04-01 08:08:23 [DEBUG   ] Got command BAM from MCS: ref #13155
2021-04-01 08:08:23 [INFO    ] Finished processing BAM request
2021-04-01 08:08:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13155   8 59305 29303029 A  ERROR'
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:08:23 [DEBUG   ] spawn_process: at 2021-04-01 08:08:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:08:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:09:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 08:09:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:09:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 08:09:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:09:02 [DEBUG   ] Finished updating board flags in 2.344 seconds
2021-04-01 08:09:13 [DEBUG   ] Got command BAM from MCS: ref #13158
2021-04-01 08:09:13 [INFO    ] Finished processing BAM request
2021-04-01 08:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13158   8 59305 29353029 A  ERROR'
2021-04-01 08:09:13 [DEBUG   ] Got command BAM from MCS: ref #13157
2021-04-01 08:09:13 [INFO    ] Finished processing BAM request
2021-04-01 08:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13157   8 59305 29353033 A  ERROR'
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:09:13 [DEBUG   ] spawn_process: at 2021-04-01 08:09:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:09:20 [DEBUG   ] Got command RPT from MCS: ref #13159
2021-04-01 08:09:20 [DEBUG   ] summary = ERROR
2021-04-01 08:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13159  13 59305 29360485 A  ERRORERROR'
2021-04-01 08:09:20 [DEBUG   ] Got command RPT from MCS: ref #13160
2021-04-01 08:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13160  77 59305 29360485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:09:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:09:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:09:54 [DEBUG   ] Got command RPT from MCS: ref #13179
2021-04-01 08:09:54 [DEBUG   ] summary = ERROR
2021-04-01 08:09:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13179  13 59305 29394893 A  ERRORERROR'
2021-04-01 08:09:55 [DEBUG   ] Got command RPT from MCS: ref #13181
2021-04-01 08:09:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13181  77 59305 29395097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:09:55 [DEBUG   ] Got command RPT from MCS: ref #13183
2021-04-01 08:09:55 [DEBUG   ] summary = ERROR
2021-04-01 08:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13183  13 59305 29395289 A  ERRORERROR'
2021-04-01 08:09:55 [DEBUG   ] Got command RPT from MCS: ref #13185
2021-04-01 08:09:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13185  77 59305 29395493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:09:55 [DEBUG   ] Got command RPT from MCS: ref #13188
2021-04-01 08:09:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13188  12 59305 29395697 A  ERRORB¢ff'
2021-04-01 08:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 08:10:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:10:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:10:01 [DEBUG   ] Finished updating board flags in 1.262 seconds
2021-04-01 08:10:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:10:03 [DEBUG   ] Got command BAM from MCS: ref #13195
2021-04-01 08:10:03 [INFO    ] Finished processing BAM request
2021-04-01 08:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13195   8 59305 29403029 A  ERROR'
2021-04-01 08:10:03 [DEBUG   ] Got command BAM from MCS: ref #13194
2021-04-01 08:10:03 [INFO    ] Finished processing BAM request
2021-04-01 08:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13194   8 59305 29403033 A  ERROR'
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:10:03 [DEBUG   ] spawn_process: at 2021-04-01 08:10:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:10:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:10:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:10:53 [DEBUG   ] Got command BAM from MCS: ref #13196
2021-04-01 08:10:53 [INFO    ] Finished processing BAM request
2021-04-01 08:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13196   8 59305 29453033 A  ERROR'
2021-04-01 08:10:53 [DEBUG   ] Got command BAM from MCS: ref #13197
2021-04-01 08:10:53 [INFO    ] Finished processing BAM request
2021-04-01 08:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13197   8 59305 29453037 A  ERROR'
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:10:53 [DEBUG   ] spawn_process: at 2021-04-01 08:10:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:11:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:11:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:11:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:11:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:11:01 [DEBUG   ] Finished updating board flags in 1.174 seconds
2021-04-01 08:11:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 08:11:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:11:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:11:43 [DEBUG   ] Got command BAM from MCS: ref #13199
2021-04-01 08:11:43 [INFO    ] Finished processing BAM request
2021-04-01 08:11:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13199   8 59305 29503025 A  ERROR'
2021-04-01 08:11:43 [DEBUG   ] Got command BAM from MCS: ref #13198
2021-04-01 08:11:43 [INFO    ] Finished processing BAM request
2021-04-01 08:11:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13198   8 59305 29503029 A  ERROR'
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:11:43 [DEBUG   ] spawn_process: at 2021-04-01 08:11:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:12:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:12:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:12:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:12:01 [DEBUG   ] Finished updating board flags in 1.026 seconds
2021-04-01 08:12:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 08:12:23 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2021-04-01 08:12:33 [DEBUG   ] Got command BAM from MCS: ref #13200
2021-04-01 08:12:33 [INFO    ] Finished processing BAM request
2021-04-01 08:12:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13200   8 59305 29553025 A  ERROR'
2021-04-01 08:12:33 [DEBUG   ] Got command BAM from MCS: ref #13201
2021-04-01 08:12:33 [INFO    ] Finished processing BAM request
2021-04-01 08:12:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13201   8 59305 29553029 A  ERROR'
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:12:33 [DEBUG   ] spawn_process: at 2021-04-01 08:12:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:12:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:13:02 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2021-04-01 08:13:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:13:02 [DEBUG   ] Finished updating board flags in 2.016 seconds
2021-04-01 08:13:22 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 08:13:23 [DEBUG   ] Got command BAM from MCS: ref #13208
2021-04-01 08:13:23 [INFO    ] Finished processing BAM request
2021-04-01 08:13:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13208   8 59305 29603033 A  ERROR'
2021-04-01 08:13:23 [DEBUG   ] Got command BAM from MCS: ref #13209
2021-04-01 08:13:23 [INFO    ] Finished processing BAM request
2021-04-01 08:13:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13209   8 59305 29603037 A  ERROR'
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:13:23 [DEBUG   ] spawn_process: at 2021-04-01 08:13:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:13:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 08:14:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2021-04-01 08:14:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:14:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:14:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:14:01 [DEBUG   ] Finished updating board flags in 1.398 seconds
2021-04-01 08:14:02 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 08:14:13 [DEBUG   ] Got command BAM from MCS: ref #13211
2021-04-01 08:14:13 [INFO    ] Finished processing BAM request
2021-04-01 08:14:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:14:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13211   8 59305 29653033 A  ERROR'
2021-04-01 08:14:13 [DEBUG   ] Got command BAM from MCS: ref #13210
2021-04-01 08:14:13 [INFO    ] Finished processing BAM request
2021-04-01 08:14:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:14:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13210   8 59305 29653037 A  ERROR'
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:14:13 [DEBUG   ] spawn_process: at 2021-04-01 08:14:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:14:20 [DEBUG   ] Got command RPT from MCS: ref #13212
2021-04-01 08:14:20 [DEBUG   ] summary = ERROR
2021-04-01 08:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13212  13 59305 29660489 A  ERRORERROR'
2021-04-01 08:14:20 [DEBUG   ] Got command RPT from MCS: ref #13213
2021-04-01 08:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13213  77 59305 29660489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:14:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:14:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:14:54 [DEBUG   ] Got command RPT from MCS: ref #13229
2021-04-01 08:14:54 [DEBUG   ] summary = ERROR
2021-04-01 08:14:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13229  13 59305 29694965 A  ERRORERROR'
2021-04-01 08:14:55 [DEBUG   ] Got command RPT from MCS: ref #13230
2021-04-01 08:14:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13230  77 59305 29695169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:14:55 [DEBUG   ] Got command RPT from MCS: ref #13231
2021-04-01 08:14:55 [DEBUG   ] summary = ERROR
2021-04-01 08:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13231  13 59305 29695361 A  ERRORERROR'
2021-04-01 08:14:55 [DEBUG   ] Got command RPT from MCS: ref #13232
2021-04-01 08:14:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13232  77 59305 29695565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:14:55 [DEBUG   ] Got command RPT from MCS: ref #13233
2021-04-01 08:14:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13233  12 59305 29695769 A  ERRORB£ff'
2021-04-01 08:15:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:15:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:15:01 [DEBUG   ] Finished updating board flags in 1.218 seconds
2021-04-01 08:15:03 [DEBUG   ] Got command BAM from MCS: ref #13234
2021-04-01 08:15:03 [INFO    ] Finished processing BAM request
2021-04-01 08:15:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13234   8 59305 29703029 A  ERROR'
2021-04-01 08:15:03 [DEBUG   ] Got command BAM from MCS: ref #13235
2021-04-01 08:15:03 [INFO    ] Finished processing BAM request
2021-04-01 08:15:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13235   8 59305 29703033 A  ERROR'
2021-04-01 08:15:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:15:03 [DEBUG   ] spawn_process: at 2021-04-01 08:15:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:15:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:15:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:15:53 [DEBUG   ] Got command BAM from MCS: ref #13236
2021-04-01 08:15:53 [INFO    ] Finished processing BAM request
2021-04-01 08:15:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13236   8 59305 29753029 A  ERROR'
2021-04-01 08:15:53 [DEBUG   ] Got command BAM from MCS: ref #13237
2021-04-01 08:15:53 [INFO    ] Finished processing BAM request
2021-04-01 08:15:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13237   8 59305 29753033 A  ERROR'
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:15:53 [DEBUG   ] spawn_process: at 2021-04-01 08:15:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:16:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:16:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:16:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:16:01 [DEBUG   ] Finished updating board flags in 1.164 seconds
2021-04-01 08:16:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:16:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:16:43 [DEBUG   ] Got command BAM from MCS: ref #13244
2021-04-01 08:16:43 [INFO    ] Finished processing BAM request
2021-04-01 08:16:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13244   8 59305 29803033 A  ERROR'
2021-04-01 08:16:43 [DEBUG   ] Got command BAM from MCS: ref #13245
2021-04-01 08:16:43 [INFO    ] Finished processing BAM request
2021-04-01 08:16:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13245   8 59305 29803037 A  ERROR'
2021-04-01 08:16:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:16:43 [DEBUG   ] spawn_process: at 2021-04-01 08:16:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:17:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2021-04-01 08:17:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:17:02 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 08:17:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:17:02 [DEBUG   ] Finished updating board flags in 1.611 seconds
2021-04-01 08:17:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:17:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:17:33 [DEBUG   ] Got command BAM from MCS: ref #13246
2021-04-01 08:17:33 [INFO    ] Finished processing BAM request
2021-04-01 08:17:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13246   8 59305 29853029 A  ERROR'
2021-04-01 08:17:33 [DEBUG   ] Got command BAM from MCS: ref #13247
2021-04-01 08:17:33 [INFO    ] Finished processing BAM request
2021-04-01 08:17:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13247   8 59305 29853033 A  ERROR'
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:17:33 [DEBUG   ] spawn_process: at 2021-04-01 08:17:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:17:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:18:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2021-04-01 08:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:18:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:18:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:18:01 [DEBUG   ] Finished updating board flags in 1.059 seconds
2021-04-01 08:18:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:18:23 [DEBUG   ] Got command BAM from MCS: ref #13248
2021-04-01 08:18:23 [INFO    ] Finished processing BAM request
2021-04-01 08:18:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13248   8 59305 29903033 A  ERROR'
2021-04-01 08:18:23 [DEBUG   ] Got command BAM from MCS: ref #13249
2021-04-01 08:18:23 [INFO    ] Finished processing BAM request
2021-04-01 08:18:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13249   8 59305 29903037 A  ERROR'
2021-04-01 08:18:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:18:23 [DEBUG   ] spawn_process: at 2021-04-01 08:18:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:18:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:19:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 08:19:01 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:19:01 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:19:01 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:19:01 [DEBUG   ] Finished updating board flags in 0.956 seconds
2021-04-01 08:19:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:19:13 [DEBUG   ] Got command BAM from MCS: ref #13257
2021-04-01 08:19:13 [INFO    ] Finished processing BAM request
2021-04-01 08:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13257   8 59305 29953025 A  ERROR'
2021-04-01 08:19:13 [DEBUG   ] Got command BAM from MCS: ref #13256
2021-04-01 08:19:13 [INFO    ] Finished processing BAM request
2021-04-01 08:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13256   8 59305 29953029 A  ERROR'
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:19:13 [DEBUG   ] spawn_process: at 2021-04-01 08:19:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:19:20 [DEBUG   ] Got command RPT from MCS: ref #13258
2021-04-01 08:19:20 [DEBUG   ] summary = ERROR
2021-04-01 08:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13258  13 59305 29960485 A  ERRORERROR'
2021-04-01 08:19:20 [DEBUG   ] Got command RPT from MCS: ref #13259
2021-04-01 08:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13259  77 59305 29960485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:19:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:19:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:19:55 [DEBUG   ] Got command RPT from MCS: ref #13277
2021-04-01 08:19:55 [DEBUG   ] summary = ERROR
2021-04-01 08:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13277  13 59305 29995037 A  ERRORERROR'
2021-04-01 08:19:55 [DEBUG   ] Got command RPT from MCS: ref #13278
2021-04-01 08:19:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13278  77 59305 29995241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:19:55 [DEBUG   ] Got command RPT from MCS: ref #13279
2021-04-01 08:19:55 [DEBUG   ] summary = ERROR
2021-04-01 08:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13279  13 59305 29995445 A  ERRORERROR'
2021-04-01 08:19:55 [DEBUG   ] Got command RPT from MCS: ref #13280
2021-04-01 08:19:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13280  77 59305 29995637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:19:55 [DEBUG   ] Got command RPT from MCS: ref #13282
2021-04-01 08:19:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13282  12 59305 29995841 A  ERRORB¤ff'
2021-04-01 08:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:20:02 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:20:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:20:02 [DEBUG   ] Finished updating board flags in 1.426 seconds
2021-04-01 08:20:03 [DEBUG   ] Got command BAM from MCS: ref #13287
2021-04-01 08:20:03 [INFO    ] Finished processing BAM request
2021-04-01 08:20:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13287   8 59305 30003025 A  ERROR'
2021-04-01 08:20:03 [DEBUG   ] Got command BAM from MCS: ref #13288
2021-04-01 08:20:03 [INFO    ] Finished processing BAM request
2021-04-01 08:20:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13288   8 59305 30003029 A  ERROR'
2021-04-01 08:20:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:20:03 [DEBUG   ] spawn_process: at 2021-04-01 08:20:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:20:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:20:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:20:53 [DEBUG   ] Got command BAM from MCS: ref #13290
2021-04-01 08:20:53 [INFO    ] Finished processing BAM request
2021-04-01 08:20:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:20:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13290   8 59305 30053029 A  ERROR'
2021-04-01 08:20:53 [DEBUG   ] Got command BAM from MCS: ref #13289
2021-04-01 08:20:53 [INFO    ] Finished processing BAM request
2021-04-01 08:20:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:20:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13289   8 59305 30053033 A  ERROR'
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:20:53 [DEBUG   ] spawn_process: at 2021-04-01 08:20:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2021-04-01 08:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 08:21:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:21:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 08:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:21:02 [DEBUG   ] Finished updating board flags in 1.372 seconds
2021-04-01 08:21:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:21:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:21:43 [DEBUG   ] Got command BAM from MCS: ref #13292
2021-04-01 08:21:43 [INFO    ] Finished processing BAM request
2021-04-01 08:21:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13292   8 59305 30103029 A  ERROR'
2021-04-01 08:21:43 [DEBUG   ] Got command BAM from MCS: ref #13291
2021-04-01 08:21:43 [INFO    ] Finished processing BAM request
2021-04-01 08:21:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13291   8 59305 30103033 A  ERROR'
2021-04-01 08:21:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:21:43 [DEBUG   ] spawn_process: at 2021-04-01 08:21:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 08:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:22:02 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:22:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:22:02 [DEBUG   ] Finished updating board flags in 1.219 seconds
2021-04-01 08:22:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:22:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:22:33 [DEBUG   ] Got command BAM from MCS: ref #13299
2021-04-01 08:22:33 [INFO    ] Finished processing BAM request
2021-04-01 08:22:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13299   8 59305 30153029 A  ERROR'
2021-04-01 08:22:33 [DEBUG   ] Got command BAM from MCS: ref #13300
2021-04-01 08:22:33 [INFO    ] Finished processing BAM request
2021-04-01 08:22:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13300   8 59305 30153033 A  ERROR'
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:22:33 [DEBUG   ] spawn_process: at 2021-04-01 08:22:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:22:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:23:02 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:23:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 08:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:23:02 [DEBUG   ] Finished updating board flags in 1.193 seconds
2021-04-01 08:23:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:23:23 [DEBUG   ] Got command BAM from MCS: ref #13301
2021-04-01 08:23:23 [INFO    ] Finished processing BAM request
2021-04-01 08:23:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13301   8 59305 30203025 A  ERROR'
2021-04-01 08:23:23 [DEBUG   ] Got command BAM from MCS: ref #13302
2021-04-01 08:23:23 [INFO    ] Finished processing BAM request
2021-04-01 08:23:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13302   8 59305 30203029 A  ERROR'
2021-04-01 08:23:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:23:23 [DEBUG   ] spawn_process: at 2021-04-01 08:23:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:23:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:24:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:24:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:24:03 [DEBUG   ] Finished updating ant stats in 1.233 seconds
2021-04-01 08:24:03 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:24:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:24:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:24:03 [DEBUG   ] Finished updating board flags in 2.050 seconds
2021-04-01 08:24:13 [DEBUG   ] Got command BAM from MCS: ref #13303
2021-04-01 08:24:13 [INFO    ] Finished processing BAM request
2021-04-01 08:24:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13303   8 59305 30253033 A  ERROR'
2021-04-01 08:24:13 [DEBUG   ] Got command BAM from MCS: ref #13304
2021-04-01 08:24:13 [INFO    ] Finished processing BAM request
2021-04-01 08:24:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13304   8 59305 30253037 A  ERROR'
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:24:13 [DEBUG   ] spawn_process: at 2021-04-01 08:24:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:24:20 [DEBUG   ] Got command RPT from MCS: ref #13305
2021-04-01 08:24:20 [DEBUG   ] summary = ERROR
2021-04-01 08:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13305  13 59305 30260489 A  ERRORERROR'
2021-04-01 08:24:20 [DEBUG   ] Got command RPT from MCS: ref #13306
2021-04-01 08:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13306  77 59305 30260489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:24:23 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2021-04-01 08:24:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:24:55 [DEBUG   ] Got command RPT from MCS: ref #13323
2021-04-01 08:24:55 [DEBUG   ] summary = ERROR
2021-04-01 08:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13323  13 59305 30295109 A  ERRORERROR'
2021-04-01 08:24:55 [DEBUG   ] Got command RPT from MCS: ref #13325
2021-04-01 08:24:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13325  77 59305 30295313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:24:55 [DEBUG   ] Got command RPT from MCS: ref #13327
2021-04-01 08:24:55 [DEBUG   ] summary = ERROR
2021-04-01 08:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13327  13 59305 30295517 A  ERRORERROR'
2021-04-01 08:24:55 [DEBUG   ] Got command RPT from MCS: ref #13329
2021-04-01 08:24:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13329  77 59305 30295725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:24:55 [DEBUG   ] Got command RPT from MCS: ref #13331
2021-04-01 08:24:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13331  12 59305 30295909 A  ERRORB¥ff'
2021-04-01 08:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:25:03 [DEBUG   ] Got command BAM from MCS: ref #13334
2021-04-01 08:25:03 [INFO    ] Finished processing BAM request
2021-04-01 08:25:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13334   8 59305 30303029 A  ERROR'
2021-04-01 08:25:03 [DEBUG   ] Got command BAM from MCS: ref #13333
2021-04-01 08:25:03 [INFO    ] Finished processing BAM request
2021-04-01 08:25:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13333   8 59305 30303033 A  ERROR'
2021-04-01 08:25:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 08:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:25:03 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:25:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:25:03 [DEBUG   ] Finished updating board flags in 2.360 seconds
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:25:03 [DEBUG   ] spawn_process: at 2021-04-01 08:25:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:25:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:25:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:25:53 [DEBUG   ] Got command BAM from MCS: ref #13336
2021-04-01 08:25:53 [INFO    ] Finished processing BAM request
2021-04-01 08:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13336   8 59305 30353025 A  ERROR'
2021-04-01 08:25:53 [DEBUG   ] Got command BAM from MCS: ref #13335
2021-04-01 08:25:53 [INFO    ] Finished processing BAM request
2021-04-01 08:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13335   8 59305 30353029 A  ERROR'
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:25:53 [DEBUG   ] spawn_process: at 2021-04-01 08:25:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 08:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:26:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:26:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:26:02 [DEBUG   ] Finished updating board flags in 1.251 seconds
2021-04-01 08:26:03 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 08:26:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:26:43 [DEBUG   ] Got command BAM from MCS: ref #13337
2021-04-01 08:26:43 [INFO    ] Finished processing BAM request
2021-04-01 08:26:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13337   8 59305 30403033 A  ERROR'
2021-04-01 08:26:43 [DEBUG   ] Got command BAM from MCS: ref #13338
2021-04-01 08:26:43 [INFO    ] Finished processing BAM request
2021-04-01 08:26:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13338   8 59305 30403037 A  ERROR'
2021-04-01 08:26:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:26:43 [DEBUG   ] spawn_process: at 2021-04-01 08:26:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2021-04-01 08:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 08:27:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:27:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:27:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:27:02 [DEBUG   ] Finished updating board flags in 1.188 seconds
2021-04-01 08:27:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:27:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:27:33 [DEBUG   ] Got command BAM from MCS: ref #13339
2021-04-01 08:27:33 [INFO    ] Finished processing BAM request
2021-04-01 08:27:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13339   8 59305 30453025 A  ERROR'
2021-04-01 08:27:33 [DEBUG   ] Got command BAM from MCS: ref #13340
2021-04-01 08:27:33 [INFO    ] Finished processing BAM request
2021-04-01 08:27:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13340   8 59305 30453029 A  ERROR'
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:27:33 [DEBUG   ] spawn_process: at 2021-04-01 08:27:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:27:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 08:28:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:28:02 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:28:02 [DEBUG   ] Finished updating board flags in 1.030 seconds
2021-04-01 08:28:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:28:23 [DEBUG   ] Got command BAM from MCS: ref #13348
2021-04-01 08:28:23 [INFO    ] Finished processing BAM request
2021-04-01 08:28:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13348   8 59305 30503033 A  ERROR'
2021-04-01 08:28:23 [DEBUG   ] Got command BAM from MCS: ref #13347
2021-04-01 08:28:23 [INFO    ] Finished processing BAM request
2021-04-01 08:28:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13347   8 59305 30503037 A  ERROR'
2021-04-01 08:28:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:28:23 [DEBUG   ] spawn_process: at 2021-04-01 08:28:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:28:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:29:03 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2021-04-01 08:29:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:29:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:29:03 [DEBUG   ] Finished updating board flags in 1.573 seconds
2021-04-01 08:29:13 [DEBUG   ] Got command BAM from MCS: ref #13349
2021-04-01 08:29:13 [INFO    ] Finished processing BAM request
2021-04-01 08:29:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13349   8 59305 30553041 A  ERROR'
2021-04-01 08:29:13 [DEBUG   ] Got command BAM from MCS: ref #13350
2021-04-01 08:29:13 [INFO    ] Finished processing BAM request
2021-04-01 08:29:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13350   8 59305 30553045 A  ERROR'
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:29:13 [DEBUG   ] spawn_process: at 2021-04-01 08:29:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:29:20 [DEBUG   ] Got command RPT from MCS: ref #13351
2021-04-01 08:29:20 [DEBUG   ] summary = ERROR
2021-04-01 08:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13351  13 59305 30560485 A  ERRORERROR'
2021-04-01 08:29:20 [DEBUG   ] Got command RPT from MCS: ref #13352
2021-04-01 08:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13352  77 59305 30560485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:29:23 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2021-04-01 08:29:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:29:55 [DEBUG   ] Got command RPT from MCS: ref #13370
2021-04-01 08:29:55 [DEBUG   ] summary = ERROR
2021-04-01 08:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13370  13 59305 30595177 A  ERRORERROR'
2021-04-01 08:29:55 [DEBUG   ] Got command RPT from MCS: ref #13371
2021-04-01 08:29:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13371  77 59305 30595381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:29:55 [DEBUG   ] Got command RPT from MCS: ref #13372
2021-04-01 08:29:55 [DEBUG   ] summary = ERROR
2021-04-01 08:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13372  13 59305 30595585 A  ERRORERROR'
2021-04-01 08:29:55 [DEBUG   ] Got command RPT from MCS: ref #13373
2021-04-01 08:29:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13373  77 59305 30595777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:29:55 [DEBUG   ] Got command RPT from MCS: ref #13375
2021-04-01 08:29:55 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:29:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13375  12 59305 30595981 A  ERRORB¤ff'
2021-04-01 08:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:30:03 [DEBUG   ] Got command BAM from MCS: ref #13381
2021-04-01 08:30:03 [INFO    ] Finished processing BAM request
2021-04-01 08:30:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13381   8 59305 30603033 A  ERROR'
2021-04-01 08:30:03 [DEBUG   ] Got command BAM from MCS: ref #13380
2021-04-01 08:30:03 [INFO    ] Finished processing BAM request
2021-04-01 08:30:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13380   8 59305 30603037 A  ERROR'
2021-04-01 08:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 08:30:03 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2021-04-01 08:30:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:30:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:30:03 [DEBUG   ] Finished updating board flags in 1.374 seconds
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:30:03 [DEBUG   ] spawn_process: at 2021-04-01 08:30:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:30:23 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 08:30:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 08:30:53 [DEBUG   ] Got command BAM from MCS: ref #13383
2021-04-01 08:30:53 [INFO    ] Finished processing BAM request
2021-04-01 08:30:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:30:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13383   8 59305 30653025 A  ERROR'
2021-04-01 08:30:53 [DEBUG   ] Got command BAM from MCS: ref #13382
2021-04-01 08:30:53 [INFO    ] Finished processing BAM request
2021-04-01 08:30:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:30:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13382   8 59305 30653029 A  ERROR'
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:30:53 [DEBUG   ] spawn_process: at 2021-04-01 08:30:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 08:31:03 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2021-04-01 08:31:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:31:03 [DEBUG   ] Finished updating board flags in 1.200 seconds
2021-04-01 08:31:23 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2021-04-01 08:31:43 [DEBUG   ] Got command BAM from MCS: ref #13390
2021-04-01 08:31:43 [INFO    ] Finished processing BAM request
2021-04-01 08:31:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13390   8 59305 30703033 A  ERROR'
2021-04-01 08:31:43 [DEBUG   ] Got command BAM from MCS: ref #13391
2021-04-01 08:31:43 [INFO    ] Finished processing BAM request
2021-04-01 08:31:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13391   8 59305 30703037 A  ERROR'
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:31:43 [DEBUG   ] spawn_process: at 2021-04-01 08:31:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:31:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:32:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:32:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:32:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:32:03 [DEBUG   ] Finished updating board flags in 1.163 seconds
2021-04-01 08:32:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:32:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:32:33 [DEBUG   ] Got command BAM from MCS: ref #13392
2021-04-01 08:32:33 [INFO    ] Finished processing BAM request
2021-04-01 08:32:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13392   8 59305 30753029 A  ERROR'
2021-04-01 08:32:33 [DEBUG   ] Got command BAM from MCS: ref #13393
2021-04-01 08:32:33 [INFO    ] Finished processing BAM request
2021-04-01 08:32:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:32:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13393   8 59305 30753033 A  ERROR'
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:32:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:32:33 [DEBUG   ] spawn_process: at 2021-04-01 08:32:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:32:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 08:33:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:33:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 08:33:04 [DEBUG   ] Finished updating ant stats in 1.230 seconds
2021-04-01 08:33:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:33:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:33:04 [DEBUG   ] Finished updating board flags in 2.111 seconds
2021-04-01 08:33:23 [DEBUG   ] Got command BAM from MCS: ref #13394
2021-04-01 08:33:23 [INFO    ] Finished processing BAM request
2021-04-01 08:33:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13394   8 59305 30803025 A  ERROR'
2021-04-01 08:33:23 [DEBUG   ] Got command BAM from MCS: ref #13395
2021-04-01 08:33:23 [INFO    ] Finished processing BAM request
2021-04-01 08:33:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13395   8 59305 30803029 A  ERROR'
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:33:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:33:23 [DEBUG   ] spawn_process: at 2021-04-01 08:33:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:33:24 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2021-04-01 08:33:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 08:34:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:34:04 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2021-04-01 08:34:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:34:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:34:04 [DEBUG   ] Finished updating board flags in 1.915 seconds
2021-04-01 08:34:13 [DEBUG   ] Got command BAM from MCS: ref #13403
2021-04-01 08:34:13 [INFO    ] Finished processing BAM request
2021-04-01 08:34:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13403   8 59305 30853033 A  ERROR'
2021-04-01 08:34:13 [DEBUG   ] Got command BAM from MCS: ref #13402
2021-04-01 08:34:13 [INFO    ] Finished processing BAM request
2021-04-01 08:34:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:34:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13402   8 59305 30853037 A  ERROR'
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:34:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:34:13 [DEBUG   ] spawn_process: at 2021-04-01 08:34:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:34:20 [DEBUG   ] Got command RPT from MCS: ref #13404
2021-04-01 08:34:20 [DEBUG   ] summary = ERROR
2021-04-01 08:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13404  13 59305 30860493 A  ERRORERROR'
2021-04-01 08:34:20 [DEBUG   ] Got command RPT from MCS: ref #13405
2021-04-01 08:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13405  77 59305 30860493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:34:24 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2021-04-01 08:34:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 08:34:55 [DEBUG   ] Got command RPT from MCS: ref #13421
2021-04-01 08:34:55 [DEBUG   ] summary = ERROR
2021-04-01 08:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13421  13 59305 30895257 A  ERRORERROR'
2021-04-01 08:34:55 [DEBUG   ] Got command RPT from MCS: ref #13422
2021-04-01 08:34:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13422  77 59305 30895461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:34:55 [DEBUG   ] Got command RPT from MCS: ref #13423
2021-04-01 08:34:55 [DEBUG   ] summary = ERROR
2021-04-01 08:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13423  13 59305 30895653 A  ERRORERROR'
2021-04-01 08:34:55 [DEBUG   ] Got command RPT from MCS: ref #13424
2021-04-01 08:34:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:34:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13424  77 59305 30895857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:34:56 [DEBUG   ] Got command RPT from MCS: ref #13425
2021-04-01 08:34:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13425  12 59305 30896061 A  ERRORB£ff'
2021-04-01 08:35:03 [DEBUG   ] Got command BAM from MCS: ref #13427
2021-04-01 08:35:03 [INFO    ] Finished processing BAM request
2021-04-01 08:35:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13427   8 59305 30903033 A  ERROR'
2021-04-01 08:35:03 [DEBUG   ] Got command BAM from MCS: ref #13426
2021-04-01 08:35:03 [INFO    ] Finished processing BAM request
2021-04-01 08:35:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13426   8 59305 30903041 A  ERROR'
2021-04-01 08:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:35:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:35:03 [DEBUG   ] spawn_process: at 2021-04-01 08:35:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:35:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2021-04-01 08:35:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 08:35:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:35:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:35:04 [DEBUG   ] Finished updating board flags in 1.981 seconds
2021-04-01 08:35:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 08:35:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:35:53 [DEBUG   ] Got command BAM from MCS: ref #13428
2021-04-01 08:35:53 [INFO    ] Finished processing BAM request
2021-04-01 08:35:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:35:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13428   8 59305 30953033 A  ERROR'
2021-04-01 08:35:53 [DEBUG   ] Got command BAM from MCS: ref #13429
2021-04-01 08:35:53 [INFO    ] Finished processing BAM request
2021-04-01 08:35:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:35:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13429   8 59305 30953037 A  ERROR'
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:35:53 [DEBUG   ] spawn_process: at 2021-04-01 08:35:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:36:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:36:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 08:36:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:36:03 [DEBUG   ] Finished updating board flags in 1.074 seconds
2021-04-01 08:36:04 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 08:36:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 08:36:43 [DEBUG   ] Got command BAM from MCS: ref #13431
2021-04-01 08:36:43 [INFO    ] Finished processing BAM request
2021-04-01 08:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13431   8 59305 31003025 A  ERROR'
2021-04-01 08:36:43 [DEBUG   ] Got command BAM from MCS: ref #13430
2021-04-01 08:36:43 [INFO    ] Finished processing BAM request
2021-04-01 08:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13430   8 59305 31003029 A  ERROR'
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:36:43 [DEBUG   ] spawn_process: at 2021-04-01 08:36:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:36:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 08:37:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:37:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:37:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:37:03 [DEBUG   ] Finished updating board flags in 1.025 seconds
2021-04-01 08:37:04 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 08:37:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:37:33 [DEBUG   ] Got command BAM from MCS: ref #13438
2021-04-01 08:37:33 [INFO    ] Finished processing BAM request
2021-04-01 08:37:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13438   8 59305 31053029 A  ERROR'
2021-04-01 08:37:33 [DEBUG   ] Got command BAM from MCS: ref #13439
2021-04-01 08:37:33 [INFO    ] Finished processing BAM request
2021-04-01 08:37:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13439   8 59305 31053033 A  ERROR'
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:37:33 [DEBUG   ] spawn_process: at 2021-04-01 08:37:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:37:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 08:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:38:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:38:03 [DEBUG   ] Finished updating board flags in 0.919 seconds
2021-04-01 08:38:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:38:23 [DEBUG   ] Got command BAM from MCS: ref #13441
2021-04-01 08:38:23 [INFO    ] Finished processing BAM request
2021-04-01 08:38:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13441   8 59305 31103025 A  ERROR'
2021-04-01 08:38:23 [DEBUG   ] Got command BAM from MCS: ref #13440
2021-04-01 08:38:23 [INFO    ] Finished processing BAM request
2021-04-01 08:38:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13440   8 59305 31103029 A  ERROR'
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:38:23 [DEBUG   ] spawn_process: at 2021-04-01 08:38:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:38:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:38:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:39:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:39:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 08:39:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:39:04 [DEBUG   ] Finished updating board flags in 1.423 seconds
2021-04-01 08:39:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:39:13 [DEBUG   ] Got command BAM from MCS: ref #13443
2021-04-01 08:39:13 [INFO    ] Finished processing BAM request
2021-04-01 08:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13443   8 59305 31153029 A  ERROR'
2021-04-01 08:39:13 [DEBUG   ] Got command BAM from MCS: ref #13442
2021-04-01 08:39:13 [INFO    ] Finished processing BAM request
2021-04-01 08:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13442   8 59305 31153033 A  ERROR'
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:39:13 [DEBUG   ] spawn_process: at 2021-04-01 08:39:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:39:20 [DEBUG   ] Got command RPT from MCS: ref #13444
2021-04-01 08:39:20 [DEBUG   ] summary = ERROR
2021-04-01 08:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13444  13 59305 31160497 A  ERRORERROR'
2021-04-01 08:39:20 [DEBUG   ] Got command RPT from MCS: ref #13445
2021-04-01 08:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13445  77 59305 31160497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:39:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:39:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:39:55 [DEBUG   ] Got command RPT from MCS: ref #13464
2021-04-01 08:39:55 [DEBUG   ] summary = ERROR
2021-04-01 08:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13464  13 59305 31195333 A  ERRORERROR'
2021-04-01 08:39:55 [DEBUG   ] Got command RPT from MCS: ref #13466
2021-04-01 08:39:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13466  77 59305 31195525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:39:55 [DEBUG   ] Got command RPT from MCS: ref #13468
2021-04-01 08:39:55 [DEBUG   ] summary = ERROR
2021-04-01 08:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13468  13 59305 31195729 A  ERRORERROR'
2021-04-01 08:39:55 [DEBUG   ] Got command RPT from MCS: ref #13470
2021-04-01 08:39:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13470  77 59305 31195933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:39:56 [DEBUG   ] Got command RPT from MCS: ref #13473
2021-04-01 08:39:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13473  12 59305 31196125 A  ERRORB£ff'
2021-04-01 08:40:03 [DEBUG   ] Got command BAM from MCS: ref #13480
2021-04-01 08:40:03 [INFO    ] Finished processing BAM request
2021-04-01 08:40:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13480   8 59305 31203029 A  ERROR'
2021-04-01 08:40:03 [DEBUG   ] Got command BAM from MCS: ref #13479
2021-04-01 08:40:03 [INFO    ] Finished processing BAM request
2021-04-01 08:40:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13479   8 59305 31203033 A  ERROR'
2021-04-01 08:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2021-04-01 08:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:40:03 [DEBUG   ] spawn_process: at 2021-04-01 08:40:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:40:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:40:04 [DEBUG   ] Finished updating board flags in 1.376 seconds
2021-04-01 08:40:05 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 08:40:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:40:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 08:40:53 [DEBUG   ] Got command BAM from MCS: ref #13481
2021-04-01 08:40:53 [INFO    ] Finished processing BAM request
2021-04-01 08:40:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13481   8 59305 31253025 A  ERROR'
2021-04-01 08:40:53 [DEBUG   ] Got command BAM from MCS: ref #13482
2021-04-01 08:40:53 [INFO    ] Finished processing BAM request
2021-04-01 08:40:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13482   8 59305 31253029 A  ERROR'
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:40:53 [DEBUG   ] spawn_process: at 2021-04-01 08:40:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:41:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:41:04 [DEBUG   ] Finished updating board flags in 1.228 seconds
2021-04-01 08:41:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:41:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 08:41:43 [DEBUG   ] Got command BAM from MCS: ref #13483
2021-04-01 08:41:43 [INFO    ] Finished processing BAM request
2021-04-01 08:41:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13483   8 59305 31303029 A  ERROR'
2021-04-01 08:41:43 [DEBUG   ] Got command BAM from MCS: ref #13484
2021-04-01 08:41:43 [INFO    ] Finished processing BAM request
2021-04-01 08:41:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:41:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13484   8 59305 31303033 A  ERROR'
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:41:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:41:43 [DEBUG   ] spawn_process: at 2021-04-01 08:41:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:41:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 08:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:42:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:42:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 08:42:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:42:05 [DEBUG   ] Finished updating board flags in 2.084 seconds
2021-04-01 08:42:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 08:42:33 [DEBUG   ] Got command BAM from MCS: ref #13486
2021-04-01 08:42:33 [INFO    ] Finished processing BAM request
2021-04-01 08:42:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13486   8 59305 31353033 A  ERROR'
2021-04-01 08:42:33 [DEBUG   ] Got command BAM from MCS: ref #13485
2021-04-01 08:42:33 [INFO    ] Finished processing BAM request
2021-04-01 08:42:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:42:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13485   8 59305 31353037 A  ERROR'
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:42:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:42:33 [DEBUG   ] spawn_process: at 2021-04-01 08:42:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:42:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 08:43:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:43:04 [DEBUG   ] Finished updating board flags in 1.105 seconds
2021-04-01 08:43:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:43:23 [DEBUG   ] Got command BAM from MCS: ref #13493
2021-04-01 08:43:23 [INFO    ] Finished processing BAM request
2021-04-01 08:43:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13493   8 59305 31403033 A  ERROR'
2021-04-01 08:43:23 [DEBUG   ] Got command BAM from MCS: ref #13494
2021-04-01 08:43:23 [INFO    ] Finished processing BAM request
2021-04-01 08:43:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13494   8 59305 31403037 A  ERROR'
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:43:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:43:23 [DEBUG   ] spawn_process: at 2021-04-01 08:43:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:43:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:43:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2021-04-01 08:44:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:44:05 [DEBUG   ] Finished updating ant stats in 0.632 seconds
2021-04-01 08:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 08:44:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:44:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:44:05 [DEBUG   ] Finished updating board flags in 2.048 seconds
2021-04-01 08:44:13 [DEBUG   ] Got command BAM from MCS: ref #13496
2021-04-01 08:44:13 [INFO    ] Finished processing BAM request
2021-04-01 08:44:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13496   8 59305 31453025 A  ERROR'
2021-04-01 08:44:13 [DEBUG   ] Got command BAM from MCS: ref #13495
2021-04-01 08:44:13 [INFO    ] Finished processing BAM request
2021-04-01 08:44:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13495   8 59305 31453029 A  ERROR'
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:44:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:44:13 [DEBUG   ] spawn_process: at 2021-04-01 08:44:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:44:20 [DEBUG   ] Got command RPT from MCS: ref #13497
2021-04-01 08:44:20 [DEBUG   ] summary = ERROR
2021-04-01 08:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13497  13 59305 31460493 A  ERRORERROR'
2021-04-01 08:44:20 [DEBUG   ] Got command RPT from MCS: ref #13498
2021-04-01 08:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13498  77 59305 31460493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:44:25 [DEBUG   ] Finished updating ant stats in 0.570 seconds
2021-04-01 08:44:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 08:44:55 [DEBUG   ] Got command RPT from MCS: ref #13514
2021-04-01 08:44:55 [DEBUG   ] summary = ERROR
2021-04-01 08:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13514  13 59305 31495405 A  ERRORERROR'
2021-04-01 08:44:55 [DEBUG   ] Got command RPT from MCS: ref #13515
2021-04-01 08:44:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13515  77 59305 31495597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:44:55 [DEBUG   ] Got command RPT from MCS: ref #13516
2021-04-01 08:44:55 [DEBUG   ] summary = ERROR
2021-04-01 08:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13516  13 59305 31495801 A  ERRORERROR'
2021-04-01 08:44:56 [DEBUG   ] Got command RPT from MCS: ref #13517
2021-04-01 08:44:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13517  77 59305 31496005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:44:56 [DEBUG   ] Got command RPT from MCS: ref #13518
2021-04-01 08:44:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13518  12 59305 31496197 A  ERRORB£ff'
2021-04-01 08:45:03 [DEBUG   ] Got command BAM from MCS: ref #13520
2021-04-01 08:45:03 [INFO    ] Finished processing BAM request
2021-04-01 08:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13520   8 59305 31503029 A  ERROR'
2021-04-01 08:45:03 [DEBUG   ] Got command BAM from MCS: ref #13519
2021-04-01 08:45:03 [INFO    ] Finished processing BAM request
2021-04-01 08:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13519   8 59305 31503033 A  ERROR'
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:45:03 [DEBUG   ] spawn_process: at 2021-04-01 08:45:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:45:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:45:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:45:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:45:05 [DEBUG   ] Finished updating board flags in 1.723 seconds
2021-04-01 08:45:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2021-04-01 08:45:25 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 08:45:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:45:53 [DEBUG   ] Got command BAM from MCS: ref #13521
2021-04-01 08:45:53 [INFO    ] Finished processing BAM request
2021-04-01 08:45:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:45:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13521   8 59305 31553029 A  ERROR'
2021-04-01 08:45:53 [DEBUG   ] Got command BAM from MCS: ref #13522
2021-04-01 08:45:53 [INFO    ] Finished processing BAM request
2021-04-01 08:45:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:45:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13522   8 59305 31553033 A  ERROR'
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:45:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:45:53 [DEBUG   ] spawn_process: at 2021-04-01 08:45:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:46:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:46:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:46:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:46:04 [DEBUG   ] Finished updating board flags in 1.265 seconds
2021-04-01 08:46:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 08:46:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:46:43 [DEBUG   ] Got command BAM from MCS: ref #13529
2021-04-01 08:46:43 [INFO    ] Finished processing BAM request
2021-04-01 08:46:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13529   8 59305 31603025 A  ERROR'
2021-04-01 08:46:43 [DEBUG   ] Got command BAM from MCS: ref #13530
2021-04-01 08:46:43 [INFO    ] Finished processing BAM request
2021-04-01 08:46:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13530   8 59305 31603029 A  ERROR'
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:46:43 [DEBUG   ] spawn_process: at 2021-04-01 08:46:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:46:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:47:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 08:47:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:47:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:47:04 [DEBUG   ] Finished updating board flags in 1.222 seconds
2021-04-01 08:47:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 08:47:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:47:33 [DEBUG   ] Got command BAM from MCS: ref #13531
2021-04-01 08:47:33 [INFO    ] Finished processing BAM request
2021-04-01 08:47:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13531   8 59305 31653029 A  ERROR'
2021-04-01 08:47:33 [DEBUG   ] Got command BAM from MCS: ref #13532
2021-04-01 08:47:33 [INFO    ] Finished processing BAM request
2021-04-01 08:47:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:47:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13532   8 59305 31653033 A  ERROR'
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 08:47:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 08:47:33 [DEBUG   ] spawn_process: at 2021-04-01 08:47:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 08:47:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 08:48:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:48:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:48:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:48:05 [DEBUG   ] Finished updating board flags in 1.747 seconds
2021-04-01 08:48:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 08:48:23 [DEBUG   ] Got command BAM from MCS: ref #13533
2021-04-01 08:48:23 [INFO    ] Finished processing BAM request
2021-04-01 08:48:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13533   8 59305 31703033 A  ERROR'
2021-04-01 08:48:23 [DEBUG   ] Got command BAM from MCS: ref #13534
2021-04-01 08:48:23 [INFO    ] Finished processing BAM request
2021-04-01 08:48:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13534   8 59305 31703037 A  ERROR'
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:48:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:48:23 [DEBUG   ] spawn_process: at 2021-04-01 08:48:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:48:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 08:48:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2021-04-01 08:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 08:49:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:49:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:49:04 [DEBUG   ] Finished updating board flags in 1.000 seconds
2021-04-01 08:49:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:49:13 [DEBUG   ] Got command BAM from MCS: ref #13542
2021-04-01 08:49:13 [INFO    ] Finished processing BAM request
2021-04-01 08:49:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:49:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13542   8 59305 31753029 A  ERROR'
2021-04-01 08:49:13 [DEBUG   ] Got command BAM from MCS: ref #13541
2021-04-01 08:49:13 [INFO    ] Finished processing BAM request
2021-04-01 08:49:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:49:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13541   8 59305 31753033 A  ERROR'
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:49:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:49:13 [DEBUG   ] spawn_process: at 2021-04-01 08:49:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:49:20 [DEBUG   ] Got command RPT from MCS: ref #13543
2021-04-01 08:49:20 [DEBUG   ] summary = ERROR
2021-04-01 08:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13543  13 59305 31760497 A  ERRORERROR'
2021-04-01 08:49:20 [DEBUG   ] Got command RPT from MCS: ref #13544
2021-04-01 08:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13544  77 59305 31760497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:49:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 08:49:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:49:55 [DEBUG   ] Got command RPT from MCS: ref #13562
2021-04-01 08:49:55 [DEBUG   ] summary = ERROR
2021-04-01 08:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13562  13 59305 31795473 A  ERRORERROR'
2021-04-01 08:49:55 [DEBUG   ] Got command RPT from MCS: ref #13563
2021-04-01 08:49:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13563  77 59305 31795677 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:49:55 [DEBUG   ] Got command RPT from MCS: ref #13564
2021-04-01 08:49:55 [DEBUG   ] summary = ERROR
2021-04-01 08:49:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13564  13 59305 31795869 A  ERRORERROR'
2021-04-01 08:49:56 [DEBUG   ] Got command RPT from MCS: ref #13565
2021-04-01 08:49:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13565  77 59305 31796073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:49:56 [DEBUG   ] Got command RPT from MCS: ref #13567
2021-04-01 08:49:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13567  12 59305 31796277 A  ERRORB¤ff'
2021-04-01 08:50:03 [DEBUG   ] Got command BAM from MCS: ref #13572
2021-04-01 08:50:03 [INFO    ] Finished processing BAM request
2021-04-01 08:50:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13572   8 59305 31803025 A  ERROR'
2021-04-01 08:50:03 [DEBUG   ] Got command BAM from MCS: ref #13573
2021-04-01 08:50:03 [INFO    ] Finished processing BAM request
2021-04-01 08:50:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:50:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13573   8 59305 31803029 A  ERROR'
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:50:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:50:03 [DEBUG   ] spawn_process: at 2021-04-01 08:50:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:50:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:50:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:50:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 08:50:04 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:50:04 [DEBUG   ] Finished updating board flags in 1.018 seconds
2021-04-01 08:50:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 08:50:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 08:50:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 08:50:53 [DEBUG   ] Got command BAM from MCS: ref #13575
2021-04-01 08:50:53 [INFO    ] Finished processing BAM request
2021-04-01 08:50:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:50:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13575   8 59305 31853025 A  ERROR'
2021-04-01 08:50:53 [DEBUG   ] Got command BAM from MCS: ref #13574
2021-04-01 08:50:53 [INFO    ] Finished processing BAM request
2021-04-01 08:50:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:50:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13574   8 59305 31853029 A  ERROR'
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:50:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:50:53 [DEBUG   ] spawn_process: at 2021-04-01 08:50:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 08:51:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 08:51:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:51:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 08:51:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:51:05 [DEBUG   ] Finished updating board flags in 1.576 seconds
2021-04-01 08:51:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 08:51:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:51:43 [DEBUG   ] Got command BAM from MCS: ref #13577
2021-04-01 08:51:43 [INFO    ] Finished processing BAM request
2021-04-01 08:51:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13577   8 59305 31903033 A  ERROR'
2021-04-01 08:51:43 [DEBUG   ] Got command BAM from MCS: ref #13576
2021-04-01 08:51:43 [INFO    ] Finished processing BAM request
2021-04-01 08:51:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:51:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13576   8 59305 31903037 A  ERROR'
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:51:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:51:43 [DEBUG   ] spawn_process: at 2021-04-01 08:51:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:51:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 08:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:52:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:52:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 08:52:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:52:05 [DEBUG   ] Finished updating board flags in 1.374 seconds
2021-04-01 08:52:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:52:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:52:33 [DEBUG   ] Got command BAM from MCS: ref #13585
2021-04-01 08:52:33 [INFO    ] Finished processing BAM request
2021-04-01 08:52:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13585   8 59305 31953025 A  ERROR'
2021-04-01 08:52:33 [DEBUG   ] Got command BAM from MCS: ref #13584
2021-04-01 08:52:33 [INFO    ] Finished processing BAM request
2021-04-01 08:52:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:52:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13584   8 59305 31953029 A  ERROR'
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 08:52:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 08:52:33 [DEBUG   ] spawn_process: at 2021-04-01 08:52:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 08:52:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2021-04-01 08:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:53:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:53:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 08:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:53:05 [DEBUG   ] Finished updating board flags in 1.236 seconds
2021-04-01 08:53:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:53:23 [DEBUG   ] Got command BAM from MCS: ref #13586
2021-04-01 08:53:23 [INFO    ] Finished processing BAM request
2021-04-01 08:53:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13586   8 59305 32003025 A  ERROR'
2021-04-01 08:53:23 [DEBUG   ] Got command BAM from MCS: ref #13587
2021-04-01 08:53:23 [INFO    ] Finished processing BAM request
2021-04-01 08:53:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13587   8 59305 32003029 A  ERROR'
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:53:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:53:23 [DEBUG   ] spawn_process: at 2021-04-01 08:53:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:53:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:53:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:54:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:54:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 08:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:54:05 [DEBUG   ] Finished updating board flags in 1.209 seconds
2021-04-01 08:54:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:54:13 [DEBUG   ] Got command BAM from MCS: ref #13589
2021-04-01 08:54:13 [INFO    ] Finished processing BAM request
2021-04-01 08:54:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13589   8 59305 32053025 A  ERROR'
2021-04-01 08:54:13 [DEBUG   ] Got command BAM from MCS: ref #13588
2021-04-01 08:54:13 [INFO    ] Finished processing BAM request
2021-04-01 08:54:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13588   8 59305 32053029 A  ERROR'
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:54:13 [DEBUG   ] spawn_process: at 2021-04-01 08:54:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:54:20 [DEBUG   ] Got command RPT from MCS: ref #13590
2021-04-01 08:54:20 [DEBUG   ] summary = ERROR
2021-04-01 08:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13590  13 59305 32060493 A  ERRORERROR'
2021-04-01 08:54:20 [DEBUG   ] Got command RPT from MCS: ref #13591
2021-04-01 08:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13591  77 59305 32060493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:54:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:54:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:54:55 [DEBUG   ] Got command RPT from MCS: ref #13608
2021-04-01 08:54:55 [DEBUG   ] summary = ERROR
2021-04-01 08:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13608  13 59305 32095545 A  ERRORERROR'
2021-04-01 08:54:55 [DEBUG   ] Got command RPT from MCS: ref #13610
2021-04-01 08:54:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13610  77 59305 32095749 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:54:55 [DEBUG   ] Got command RPT from MCS: ref #13612
2021-04-01 08:54:55 [DEBUG   ] summary = ERROR
2021-04-01 08:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13612  13 59305 32095941 A  ERRORERROR'
2021-04-01 08:54:56 [DEBUG   ] Got command RPT from MCS: ref #13614
2021-04-01 08:54:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13614  77 59305 32096145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:54:56 [DEBUG   ] Got command RPT from MCS: ref #13616
2021-04-01 08:54:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13616  12 59305 32096349 A  ERRORB¥ff'
2021-04-01 08:55:03 [DEBUG   ] Got command BAM from MCS: ref #13619
2021-04-01 08:55:03 [INFO    ] Finished processing BAM request
2021-04-01 08:55:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13619   8 59305 32103025 A  ERROR'
2021-04-01 08:55:03 [DEBUG   ] Got command BAM from MCS: ref #13618
2021-04-01 08:55:03 [INFO    ] Finished processing BAM request
2021-04-01 08:55:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:55:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13618   8 59305 32103029 A  ERROR'
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:55:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:55:03 [DEBUG   ] spawn_process: at 2021-04-01 08:55:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:55:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:55:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:55:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 08:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:55:05 [DEBUG   ] Finished updating board flags in 1.149 seconds
2021-04-01 08:55:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:55:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:55:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:55:53 [DEBUG   ] Got command BAM from MCS: ref #13620
2021-04-01 08:55:53 [INFO    ] Finished processing BAM request
2021-04-01 08:55:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:55:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13620   8 59305 32153029 A  ERROR'
2021-04-01 08:55:53 [DEBUG   ] Got command BAM from MCS: ref #13621
2021-04-01 08:55:53 [INFO    ] Finished processing BAM request
2021-04-01 08:55:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:55:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13621   8 59305 32153033 A  ERROR'
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 08:55:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 08:55:53 [DEBUG   ] spawn_process: at 2021-04-01 08:55:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 08:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2021-04-01 08:56:05 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:56:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 08:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:56:05 [DEBUG   ] Finished updating board flags in 1.037 seconds
2021-04-01 08:56:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:56:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 08:56:43 [DEBUG   ] Got command BAM from MCS: ref #13622
2021-04-01 08:56:43 [INFO    ] Finished processing BAM request
2021-04-01 08:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13622   8 59305 32203033 A  ERROR'
2021-04-01 08:56:43 [DEBUG   ] Got command BAM from MCS: ref #13623
2021-04-01 08:56:43 [INFO    ] Finished processing BAM request
2021-04-01 08:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13623   8 59305 32203037 A  ERROR'
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 08:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 08:56:43 [DEBUG   ] spawn_process: at 2021-04-01 08:56:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 08:56:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 08:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2021-04-01 08:57:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 08:57:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 08:57:06 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2021-04-01 08:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2021-04-01 08:57:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:57:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 08:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 08:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:57:06 [DEBUG   ] Finished updating board flags in 2.045 seconds
2021-04-01 08:57:26 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2021-04-01 08:57:33 [DEBUG   ] Got command BAM from MCS: ref #13624
2021-04-01 08:57:33 [INFO    ] Finished processing BAM request
2021-04-01 08:57:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13624   8 59305 32253033 A  ERROR'
2021-04-01 08:57:33 [DEBUG   ] Got command BAM from MCS: ref #13625
2021-04-01 08:57:33 [INFO    ] Finished processing BAM request
2021-04-01 08:57:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13625   8 59305 32253037 A  ERROR'
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:57:33 [DEBUG   ] spawn_process: at 2021-04-01 08:57:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:57:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 08:58:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:58:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 08:58:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 08:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:58:05 [DEBUG   ] Finished updating board flags in 1.420 seconds
2021-04-01 08:58:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 08:58:23 [DEBUG   ] Got command BAM from MCS: ref #13632
2021-04-01 08:58:23 [INFO    ] Finished processing BAM request
2021-04-01 08:58:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13632   8 59305 32303029 A  ERROR'
2021-04-01 08:58:23 [DEBUG   ] Got command BAM from MCS: ref #13633
2021-04-01 08:58:23 [INFO    ] Finished processing BAM request
2021-04-01 08:58:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13633   8 59305 32303033 A  ERROR'
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:58:23 [DEBUG   ] spawn_process: at 2021-04-01 08:58:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:58:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 08:58:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 08:59:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 08:59:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 08:59:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 08:59:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 08:59:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 08:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 08:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 08:59:05 [DEBUG   ] Finished updating board flags in 1.429 seconds
2021-04-01 08:59:06 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 08:59:13 [DEBUG   ] Got command BAM from MCS: ref #13635
2021-04-01 08:59:13 [INFO    ] Finished processing BAM request
2021-04-01 08:59:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13635   8 59305 32353025 A  ERROR'
2021-04-01 08:59:13 [DEBUG   ] Got command BAM from MCS: ref #13634
2021-04-01 08:59:13 [INFO    ] Finished processing BAM request
2021-04-01 08:59:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 08:59:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13634   8 59305 32353029 A  ERROR'
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 08:59:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 08:59:13 [DEBUG   ] spawn_process: at 2021-04-01 08:59:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 08:59:20 [DEBUG   ] Got command RPT from MCS: ref #13636
2021-04-01 08:59:20 [DEBUG   ] summary = ERROR
2021-04-01 08:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13636  13 59305 32360501 A  ERRORERROR'
2021-04-01 08:59:20 [DEBUG   ] Got command RPT from MCS: ref #13637
2021-04-01 08:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13637  77 59305 32360501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:59:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:59:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 08:59:55 [DEBUG   ] Got command RPT from MCS: ref #13655
2021-04-01 08:59:55 [DEBUG   ] summary = ERROR
2021-04-01 08:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13655  13 59305 32395621 A  ERRORERROR'
2021-04-01 08:59:55 [DEBUG   ] Got command RPT from MCS: ref #13656
2021-04-01 08:59:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13656  77 59305 32395813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:59:56 [DEBUG   ] Got command RPT from MCS: ref #13657
2021-04-01 08:59:56 [DEBUG   ] summary = ERROR
2021-04-01 08:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13657  13 59305 32396017 A  ERRORERROR'
2021-04-01 08:59:56 [DEBUG   ] Got command RPT from MCS: ref #13658
2021-04-01 08:59:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 08:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13658  77 59305 32396221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 08:59:56 [DEBUG   ] Got command RPT from MCS: ref #13660
2021-04-01 08:59:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 08:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13660  12 59305 32396425 A  ERRORB¥ff'
2021-04-01 09:00:03 [DEBUG   ] Got command BAM from MCS: ref #13665
2021-04-01 09:00:03 [INFO    ] Finished processing BAM request
2021-04-01 09:00:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13665   8 59305 32403029 A  ERROR'
2021-04-01 09:00:03 [DEBUG   ] Got command BAM from MCS: ref #13666
2021-04-01 09:00:03 [INFO    ] Finished processing BAM request
2021-04-01 09:00:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:00:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13666   8 59305 32403033 A  ERROR'
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 09:00:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 09:00:03 [DEBUG   ] spawn_process: at 2021-04-01 09:00:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 09:00:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:00:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:00:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 09:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 09:00:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:00:05 [DEBUG   ] Finished updating board flags in 1.320 seconds
2021-04-01 09:00:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 09:00:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:00:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:00:53 [DEBUG   ] Got command BAM from MCS: ref #13668
2021-04-01 09:00:53 [INFO    ] Finished processing BAM request
2021-04-01 09:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13668   8 59305 32453029 A  ERROR'
2021-04-01 09:00:53 [DEBUG   ] Got command BAM from MCS: ref #13667
2021-04-01 09:00:53 [INFO    ] Finished processing BAM request
2021-04-01 09:00:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:00:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13667   8 59305 32453033 A  ERROR'
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:00:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:00:53 [DEBUG   ] spawn_process: at 2021-04-01 09:00:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:01:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 09:01:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 09:01:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:01:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:01:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:01:05 [DEBUG   ] Finished updating board flags in 1.233 seconds
2021-04-01 09:01:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:01:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:01:43 [DEBUG   ] Got command BAM from MCS: ref #13675
2021-04-01 09:01:43 [INFO    ] Finished processing BAM request
2021-04-01 09:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13675   8 59305 32503025 A  ERROR'
2021-04-01 09:01:43 [DEBUG   ] Got command BAM from MCS: ref #13676
2021-04-01 09:01:43 [INFO    ] Finished processing BAM request
2021-04-01 09:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13676   8 59305 32503029 A  ERROR'
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:01:43 [DEBUG   ] spawn_process: at 2021-04-01 09:01:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:01:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:02:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:02:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 09:02:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:02:05 [DEBUG   ] Finished updating board flags in 1.207 seconds
2021-04-01 09:02:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:02:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:02:33 [DEBUG   ] Got command BAM from MCS: ref #13678
2021-04-01 09:02:33 [INFO    ] Finished processing BAM request
2021-04-01 09:02:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13678   8 59305 32553025 A  ERROR'
2021-04-01 09:02:33 [DEBUG   ] Got command BAM from MCS: ref #13677
2021-04-01 09:02:33 [INFO    ] Finished processing BAM request
2021-04-01 09:02:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:02:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13677   8 59305 32553029 A  ERROR'
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 09:02:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 09:02:33 [DEBUG   ] spawn_process: at 2021-04-01 09:02:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 09:02:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 09:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2021-04-01 09:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2021-04-01 09:03:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:03:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 09:03:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:03:05 [DEBUG   ] Finished updating board flags in 1.239 seconds
2021-04-01 09:03:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:03:23 [DEBUG   ] Got command BAM from MCS: ref #13680
2021-04-01 09:03:23 [INFO    ] Finished processing BAM request
2021-04-01 09:03:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13680   8 59305 32603029 A  ERROR'
2021-04-01 09:03:23 [DEBUG   ] Got command BAM from MCS: ref #13679
2021-04-01 09:03:23 [INFO    ] Finished processing BAM request
2021-04-01 09:03:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13679   8 59305 32603033 A  ERROR'
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:03:23 [DEBUG   ] spawn_process: at 2021-04-01 09:03:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:03:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:03:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 09:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 09:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 09:04:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:04:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:04:06 [DEBUG   ] Finished updating board flags in 1.745 seconds
2021-04-01 09:04:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 09:04:13 [DEBUG   ] Got command BAM from MCS: ref #13688
2021-04-01 09:04:13 [INFO    ] Finished processing BAM request
2021-04-01 09:04:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13688   8 59305 32653029 A  ERROR'
2021-04-01 09:04:13 [DEBUG   ] Got command BAM from MCS: ref #13687
2021-04-01 09:04:13 [INFO    ] Finished processing BAM request
2021-04-01 09:04:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13687   8 59305 32653033 A  ERROR'
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:04:13 [DEBUG   ] spawn_process: at 2021-04-01 09:04:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:04:20 [DEBUG   ] Got command RPT from MCS: ref #13689
2021-04-01 09:04:20 [DEBUG   ] summary = ERROR
2021-04-01 09:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13689  13 59305 32660497 A  ERRORERROR'
2021-04-01 09:04:20 [DEBUG   ] Got command RPT from MCS: ref #13690
2021-04-01 09:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13690  77 59305 32660497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:04:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:04:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:04:55 [DEBUG   ] Got command RPT from MCS: ref #13706
2021-04-01 09:04:55 [DEBUG   ] summary = ERROR
2021-04-01 09:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13706  13 59305 32695697 A  ERRORERROR'
2021-04-01 09:04:55 [DEBUG   ] Got command RPT from MCS: ref #13707
2021-04-01 09:04:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13707  77 59305 32695889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:04:56 [DEBUG   ] Got command RPT from MCS: ref #13708
2021-04-01 09:04:56 [DEBUG   ] summary = ERROR
2021-04-01 09:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13708  13 59305 32696093 A  ERRORERROR'
2021-04-01 09:04:56 [DEBUG   ] Got command RPT from MCS: ref #13709
2021-04-01 09:04:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13709  77 59305 32696297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:04:56 [DEBUG   ] Got command RPT from MCS: ref #13710
2021-04-01 09:04:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13710  12 59305 32696489 A  ERRORB¥ff'
2021-04-01 09:05:03 [DEBUG   ] Got command BAM from MCS: ref #13711
2021-04-01 09:05:03 [INFO    ] Finished processing BAM request
2021-04-01 09:05:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13711   8 59305 32703033 A  ERROR'
2021-04-01 09:05:03 [DEBUG   ] Got command BAM from MCS: ref #13712
2021-04-01 09:05:03 [INFO    ] Finished processing BAM request
2021-04-01 09:05:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:05:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13712   8 59305 32703037 A  ERROR'
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:05:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:05:03 [DEBUG   ] spawn_process: at 2021-04-01 09:05:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:05:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 09:05:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:05:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:05:05 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:05:05 [DEBUG   ] Finished updating board flags in 0.994 seconds
2021-04-01 09:05:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:05:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:05:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:05:53 [DEBUG   ] Got command BAM from MCS: ref #13713
2021-04-01 09:05:53 [INFO    ] Finished processing BAM request
2021-04-01 09:05:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:05:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13713   8 59305 32753029 A  ERROR'
2021-04-01 09:05:53 [DEBUG   ] Got command BAM from MCS: ref #13714
2021-04-01 09:05:53 [INFO    ] Finished processing BAM request
2021-04-01 09:05:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:05:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13714   8 59305 32753033 A  ERROR'
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:05:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:05:53 [DEBUG   ] spawn_process: at 2021-04-01 09:05:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 09:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 09:06:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:06:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:06:06 [DEBUG   ] Finished updating board flags in 1.360 seconds
2021-04-01 09:06:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:06:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:06:43 [DEBUG   ] Got command BAM from MCS: ref #13715
2021-04-01 09:06:43 [INFO    ] Finished processing BAM request
2021-04-01 09:06:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13715   8 59305 32803029 A  ERROR'
2021-04-01 09:06:43 [DEBUG   ] Got command BAM from MCS: ref #13716
2021-04-01 09:06:43 [INFO    ] Finished processing BAM request
2021-04-01 09:06:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:06:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13716   8 59305 32803033 A  ERROR'
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:06:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:06:43 [DEBUG   ] spawn_process: at 2021-04-01 09:06:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:06:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:07:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 09:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 09:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-04-01 09:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 09:07:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:07:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:07:06 [DEBUG   ] Finished updating board flags in 1.292 seconds
2021-04-01 09:07:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 09:07:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 09:07:33 [DEBUG   ] Got command BAM from MCS: ref #13723
2021-04-01 09:07:33 [INFO    ] Finished processing BAM request
2021-04-01 09:07:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13723   8 59305 32853033 A  ERROR'
2021-04-01 09:07:33 [DEBUG   ] Got command BAM from MCS: ref #13724
2021-04-01 09:07:33 [INFO    ] Finished processing BAM request
2021-04-01 09:07:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:07:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13724   8 59305 32853037 A  ERROR'
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:07:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:07:33 [DEBUG   ] spawn_process: at 2021-04-01 09:07:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:07:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 09:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 09:08:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:08:06 [DEBUG   ] Finished updating board flags in 1.135 seconds
2021-04-01 09:08:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 09:08:23 [DEBUG   ] Got command BAM from MCS: ref #13725
2021-04-01 09:08:23 [INFO    ] Finished processing BAM request
2021-04-01 09:08:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13725   8 59305 32903029 A  ERROR'
2021-04-01 09:08:23 [DEBUG   ] Got command BAM from MCS: ref #13726
2021-04-01 09:08:23 [INFO    ] Finished processing BAM request
2021-04-01 09:08:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13726   8 59305 32903033 A  ERROR'
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:08:23 [DEBUG   ] spawn_process: at 2021-04-01 09:08:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:08:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 09:08:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:09:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 09:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:09:06 [DEBUG   ] Finished updating board flags in 1.215 seconds
2021-04-01 09:09:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:09:13 [DEBUG   ] Got command BAM from MCS: ref #13727
2021-04-01 09:09:13 [INFO    ] Finished processing BAM request
2021-04-01 09:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13727   8 59305 32953025 A  ERROR'
2021-04-01 09:09:13 [DEBUG   ] Got command BAM from MCS: ref #13728
2021-04-01 09:09:13 [INFO    ] Finished processing BAM request
2021-04-01 09:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13728   8 59305 32953029 A  ERROR'
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 09:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 09:09:13 [DEBUG   ] spawn_process: at 2021-04-01 09:09:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 09:09:20 [DEBUG   ] Got command RPT from MCS: ref #13729
2021-04-01 09:09:20 [DEBUG   ] summary = ERROR
2021-04-01 09:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13729  13 59305 32960505 A  ERRORERROR'
2021-04-01 09:09:20 [DEBUG   ] Got command RPT from MCS: ref #13730
2021-04-01 09:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13730  77 59305 32960505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:09:27 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:09:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:09:55 [DEBUG   ] Got command RPT from MCS: ref #13749
2021-04-01 09:09:55 [DEBUG   ] summary = ERROR
2021-04-01 09:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13749  13 59305 32995761 A  ERRORERROR'
2021-04-01 09:09:55 [DEBUG   ] Got command RPT from MCS: ref #13751
2021-04-01 09:09:55 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13751  77 59305 32995965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:09:56 [DEBUG   ] Got command RPT from MCS: ref #13753
2021-04-01 09:09:56 [DEBUG   ] summary = ERROR
2021-04-01 09:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13753  13 59305 32996169 A  ERRORERROR'
2021-04-01 09:09:56 [DEBUG   ] Got command RPT from MCS: ref #13755
2021-04-01 09:09:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13755  77 59305 32996361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:09:56 [DEBUG   ] Got command RPT from MCS: ref #13758
2021-04-01 09:09:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13758  12 59305 32996565 A  ERRORB¤ff'
2021-04-01 09:10:03 [DEBUG   ] Got command BAM from MCS: ref #13765
2021-04-01 09:10:03 [INFO    ] Finished processing BAM request
2021-04-01 09:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13765   8 59305 33003025 A  ERROR'
2021-04-01 09:10:03 [DEBUG   ] Got command BAM from MCS: ref #13764
2021-04-01 09:10:03 [INFO    ] Finished processing BAM request
2021-04-01 09:10:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:10:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13764   8 59305 33003029 A  ERROR'
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:10:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:10:03 [DEBUG   ] spawn_process: at 2021-04-01 09:10:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:10:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 09:10:07 [DEBUG   ] Finished updating ant stats in 0.432 seconds
2021-04-01 09:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 09:10:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 09:10:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:10:07 [DEBUG   ] Finished updating board flags in 2.066 seconds
2021-04-01 09:10:27 [DEBUG   ] Finished updating ant stats in 0.370 seconds
2021-04-01 09:10:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:10:53 [DEBUG   ] Got command BAM from MCS: ref #13766
2021-04-01 09:10:53 [INFO    ] Finished processing BAM request
2021-04-01 09:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13766   8 59305 33053025 A  ERROR'
2021-04-01 09:10:53 [DEBUG   ] Got command BAM from MCS: ref #13767
2021-04-01 09:10:53 [INFO    ] Finished processing BAM request
2021-04-01 09:10:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:10:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13767   8 59305 33053029 A  ERROR'
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:10:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:10:53 [DEBUG   ] spawn_process: at 2021-04-01 09:10:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2021-04-01 09:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 09:11:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 09:11:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:11:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:11:07 [DEBUG   ] Finished updating board flags in 1.956 seconds
2021-04-01 09:11:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 09:11:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:11:43 [DEBUG   ] Got command BAM from MCS: ref #13769
2021-04-01 09:11:43 [INFO    ] Finished processing BAM request
2021-04-01 09:11:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13769   8 59305 33103025 A  ERROR'
2021-04-01 09:11:43 [DEBUG   ] Got command BAM from MCS: ref #13768
2021-04-01 09:11:43 [INFO    ] Finished processing BAM request
2021-04-01 09:11:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13768   8 59305 33103029 A  ERROR'
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:11:43 [DEBUG   ] spawn_process: at 2021-04-01 09:11:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:11:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 09:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:12:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:12:06 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:12:06 [DEBUG   ] Finished updating board flags in 1.198 seconds
2021-04-01 09:12:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:12:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 09:12:33 [DEBUG   ] Got command BAM from MCS: ref #13771
2021-04-01 09:12:33 [INFO    ] Finished processing BAM request
2021-04-01 09:12:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13771   8 59305 33153029 A  ERROR'
2021-04-01 09:12:33 [DEBUG   ] Got command BAM from MCS: ref #13770
2021-04-01 09:12:33 [INFO    ] Finished processing BAM request
2021-04-01 09:12:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:12:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13770   8 59305 33153033 A  ERROR'
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:12:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:12:33 [DEBUG   ] spawn_process: at 2021-04-01 09:12:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:12:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:13:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 09:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 09:13:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:13:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 09:13:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:13:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:13:08 [DEBUG   ] Finished updating board flags in 2.550 seconds
2021-04-01 09:13:23 [DEBUG   ] Got command BAM from MCS: ref #13778
2021-04-01 09:13:23 [INFO    ] Finished processing BAM request
2021-04-01 09:13:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13778   8 59305 33203025 A  ERROR'
2021-04-01 09:13:23 [DEBUG   ] Got command BAM from MCS: ref #13779
2021-04-01 09:13:23 [INFO    ] Finished processing BAM request
2021-04-01 09:13:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13779   8 59305 33203029 A  ERROR'
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:13:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:13:23 [DEBUG   ] spawn_process: at 2021-04-01 09:13:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:13:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 09:13:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 09:14:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:14:07 [DEBUG   ] Finished updating board flags in 1.416 seconds
2021-04-01 09:14:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:14:13 [DEBUG   ] Got command BAM from MCS: ref #13780
2021-04-01 09:14:13 [INFO    ] Finished processing BAM request
2021-04-01 09:14:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:14:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13780   8 59305 33253033 A  ERROR'
2021-04-01 09:14:13 [DEBUG   ] Got command BAM from MCS: ref #13781
2021-04-01 09:14:13 [INFO    ] Finished processing BAM request
2021-04-01 09:14:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:14:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13781   8 59305 33253037 A  ERROR'
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:14:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:14:13 [DEBUG   ] spawn_process: at 2021-04-01 09:14:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:14:20 [DEBUG   ] Got command RPT from MCS: ref #13782
2021-04-01 09:14:20 [DEBUG   ] summary = ERROR
2021-04-01 09:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13782  13 59305 33260501 A  ERRORERROR'
2021-04-01 09:14:20 [DEBUG   ] Got command RPT from MCS: ref #13783
2021-04-01 09:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13783  77 59305 33260501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:14:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:14:48 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 09:14:55 [DEBUG   ] Got command RPT from MCS: ref #13799
2021-04-01 09:14:55 [DEBUG   ] summary = ERROR
2021-04-01 09:14:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13799  13 59305 33295837 A  ERRORERROR'
2021-04-01 09:14:56 [DEBUG   ] Got command RPT from MCS: ref #13800
2021-04-01 09:14:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13800  77 59305 33296041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:14:56 [DEBUG   ] Got command RPT from MCS: ref #13801
2021-04-01 09:14:56 [DEBUG   ] summary = ERROR
2021-04-01 09:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13801  13 59305 33296245 A  ERRORERROR'
2021-04-01 09:14:56 [DEBUG   ] Got command RPT from MCS: ref #13802
2021-04-01 09:14:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13802  77 59305 33296437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:14:56 [DEBUG   ] Got command RPT from MCS: ref #13803
2021-04-01 09:14:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13803  12 59305 33296641 A  ERRORB¤ff'
2021-04-01 09:15:03 [DEBUG   ] Got command BAM from MCS: ref #13804
2021-04-01 09:15:03 [INFO    ] Finished processing BAM request
2021-04-01 09:15:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13804   8 59305 33303029 A  ERROR'
2021-04-01 09:15:03 [DEBUG   ] Got command BAM from MCS: ref #13805
2021-04-01 09:15:03 [INFO    ] Finished processing BAM request
2021-04-01 09:15:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:15:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13805   8 59305 33303033 A  ERROR'
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:15:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:15:03 [DEBUG   ] spawn_process: at 2021-04-01 09:15:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 09:15:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:15:07 [DEBUG   ] Finished updating board flags in 1.406 seconds
2021-04-01 09:15:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 09:15:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 09:15:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 09:15:53 [DEBUG   ] Got command BAM from MCS: ref #13807
2021-04-01 09:15:53 [INFO    ] Finished processing BAM request
2021-04-01 09:15:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13807   8 59305 33353029 A  ERROR'
2021-04-01 09:15:53 [DEBUG   ] Got command BAM from MCS: ref #13806
2021-04-01 09:15:53 [INFO    ] Finished processing BAM request
2021-04-01 09:15:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13806   8 59305 33353033 A  ERROR'
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:15:53 [DEBUG   ] spawn_process: at 2021-04-01 09:15:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:16:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:16:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:16:07 [DEBUG   ] Finished updating board flags in 1.389 seconds
2021-04-01 09:16:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 09:16:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 09:16:43 [DEBUG   ] Got command BAM from MCS: ref #13814
2021-04-01 09:16:43 [INFO    ] Finished processing BAM request
2021-04-01 09:16:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13814   8 59305 33403029 A  ERROR'
2021-04-01 09:16:43 [DEBUG   ] Got command BAM from MCS: ref #13815
2021-04-01 09:16:43 [INFO    ] Finished processing BAM request
2021-04-01 09:16:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13815   8 59305 33403033 A  ERROR'
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:16:43 [DEBUG   ] spawn_process: at 2021-04-01 09:16:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:16:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 09:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:17:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:17:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:17:07 [DEBUG   ] Finished updating board flags in 1.217 seconds
2021-04-01 09:17:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 09:17:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 09:17:33 [DEBUG   ] Got command BAM from MCS: ref #13816
2021-04-01 09:17:33 [INFO    ] Finished processing BAM request
2021-04-01 09:17:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13816   8 59305 33453025 A  ERROR'
2021-04-01 09:17:33 [DEBUG   ] Got command BAM from MCS: ref #13817
2021-04-01 09:17:33 [INFO    ] Finished processing BAM request
2021-04-01 09:17:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:17:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13817   8 59305 33453029 A  ERROR'
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:17:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:17:33 [DEBUG   ] spawn_process: at 2021-04-01 09:17:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:17:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 09:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:18:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:18:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:18:07 [DEBUG   ] Finished updating board flags in 1.193 seconds
2021-04-01 09:18:08 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 09:18:23 [DEBUG   ] Got command BAM from MCS: ref #13818
2021-04-01 09:18:23 [INFO    ] Finished processing BAM request
2021-04-01 09:18:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13818   8 59305 33503025 A  ERROR'
2021-04-01 09:18:23 [DEBUG   ] Got command BAM from MCS: ref #13819
2021-04-01 09:18:23 [INFO    ] Finished processing BAM request
2021-04-01 09:18:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13819   8 59305 33503029 A  ERROR'
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:18:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:18:23 [DEBUG   ] spawn_process: at 2021-04-01 09:18:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:18:28 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 09:18:49 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 09:19:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:19:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:19:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:19:08 [DEBUG   ] Finished updating board flags in 2.039 seconds
2021-04-01 09:19:09 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2021-04-01 09:19:13 [DEBUG   ] Got command BAM from MCS: ref #13826
2021-04-01 09:19:13 [INFO    ] Finished processing BAM request
2021-04-01 09:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13826   8 59305 33553029 A  ERROR'
2021-04-01 09:19:13 [DEBUG   ] Got command BAM from MCS: ref #13827
2021-04-01 09:19:13 [INFO    ] Finished processing BAM request
2021-04-01 09:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13827   8 59305 33553033 A  ERROR'
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:19:13 [DEBUG   ] spawn_process: at 2021-04-01 09:19:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:19:20 [DEBUG   ] Got command RPT from MCS: ref #13828
2021-04-01 09:19:20 [DEBUG   ] summary = ERROR
2021-04-01 09:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13828  13 59305 33560497 A  ERRORERROR'
2021-04-01 09:19:20 [DEBUG   ] Got command RPT from MCS: ref #13829
2021-04-01 09:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13829  77 59305 33560497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:19:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:19:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:19:55 [DEBUG   ] Got command RPT from MCS: ref #13847
2021-04-01 09:19:55 [DEBUG   ] summary = ERROR
2021-04-01 09:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13847  13 59305 33595909 A  ERRORERROR'
2021-04-01 09:19:56 [DEBUG   ] Got command RPT from MCS: ref #13848
2021-04-01 09:19:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13848  77 59305 33596113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:19:56 [DEBUG   ] Got command RPT from MCS: ref #13849
2021-04-01 09:19:56 [DEBUG   ] summary = ERROR
2021-04-01 09:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13849  13 59305 33596317 A  ERRORERROR'
2021-04-01 09:19:56 [DEBUG   ] Got command RPT from MCS: ref #13850
2021-04-01 09:19:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13850  77 59305 33596509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:19:56 [DEBUG   ] Got command RPT from MCS: ref #13852
2021-04-01 09:19:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13852  12 59305 33596713 A  ERRORB£ff'
2021-04-01 09:20:03 [DEBUG   ] Got command BAM from MCS: ref #13858
2021-04-01 09:20:03 [INFO    ] Finished processing BAM request
2021-04-01 09:20:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13858   8 59305 33603029 A  ERROR'
2021-04-01 09:20:03 [DEBUG   ] Got command BAM from MCS: ref #13857
2021-04-01 09:20:03 [INFO    ] Finished processing BAM request
2021-04-01 09:20:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:20:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13857   8 59305 33603033 A  ERROR'
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 09:20:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 09:20:03 [DEBUG   ] spawn_process: at 2021-04-01 09:20:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 09:20:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:20:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:20:07 [DEBUG   ] Finished updating board flags in 1.387 seconds
2021-04-01 09:20:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 09:20:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 09:20:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:20:53 [DEBUG   ] Got command BAM from MCS: ref #13859
2021-04-01 09:20:53 [INFO    ] Finished processing BAM request
2021-04-01 09:20:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:20:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13859   8 59305 33653029 A  ERROR'
2021-04-01 09:20:53 [DEBUG   ] Got command BAM from MCS: ref #13860
2021-04-01 09:20:53 [INFO    ] Finished processing BAM request
2021-04-01 09:20:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:20:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13860   8 59305 33653033 A  ERROR'
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:20:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:20:53 [DEBUG   ] spawn_process: at 2021-04-01 09:20:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:21:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:21:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:21:07 [DEBUG   ] Finished updating board flags in 1.228 seconds
2021-04-01 09:21:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:21:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:21:43 [DEBUG   ] Got command BAM from MCS: ref #13862
2021-04-01 09:21:43 [INFO    ] Finished processing BAM request
2021-04-01 09:21:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13862   8 59305 33703033 A  ERROR'
2021-04-01 09:21:43 [DEBUG   ] Got command BAM from MCS: ref #13861
2021-04-01 09:21:43 [INFO    ] Finished processing BAM request
2021-04-01 09:21:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13861   8 59305 33703037 A  ERROR'
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:21:43 [DEBUG   ] spawn_process: at 2021-04-01 09:21:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:21:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:22:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:22:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:22:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:22:08 [DEBUG   ] Finished updating board flags in 1.796 seconds
2021-04-01 09:22:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:22:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:22:33 [DEBUG   ] Got command BAM from MCS: ref #13869
2021-04-01 09:22:33 [INFO    ] Finished processing BAM request
2021-04-01 09:22:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13869   8 59305 33753025 A  ERROR'
2021-04-01 09:22:33 [DEBUG   ] Got command BAM from MCS: ref #13870
2021-04-01 09:22:33 [INFO    ] Finished processing BAM request
2021-04-01 09:22:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:22:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13870   8 59305 33753029 A  ERROR'
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:22:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:22:33 [DEBUG   ] spawn_process: at 2021-04-01 09:22:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:22:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2021-04-01 09:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 09:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 09:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 09:23:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 09:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:23:07 [DEBUG   ] Finished updating board flags in 1.027 seconds
2021-04-01 09:23:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:23:23 [DEBUG   ] Got command BAM from MCS: ref #13872
2021-04-01 09:23:23 [INFO    ] Finished processing BAM request
2021-04-01 09:23:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13872   8 59305 33803025 A  ERROR'
2021-04-01 09:23:23 [DEBUG   ] Got command BAM from MCS: ref #13871
2021-04-01 09:23:23 [INFO    ] Finished processing BAM request
2021-04-01 09:23:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13871   8 59305 33803029 A  ERROR'
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 09:23:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 09:23:23 [DEBUG   ] spawn_process: at 2021-04-01 09:23:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 09:23:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:23:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 09:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 09:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:24:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:24:07 [DEBUG   ] Finished updating board flags in 0.980 seconds
2021-04-01 09:24:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:24:13 [DEBUG   ] Got command BAM from MCS: ref #13873
2021-04-01 09:24:13 [INFO    ] Finished processing BAM request
2021-04-01 09:24:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13873   8 59305 33853029 A  ERROR'
2021-04-01 09:24:13 [DEBUG   ] Got command BAM from MCS: ref #13874
2021-04-01 09:24:13 [INFO    ] Finished processing BAM request
2021-04-01 09:24:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:24:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13874   8 59305 33853033 A  ERROR'
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:24:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:24:13 [DEBUG   ] spawn_process: at 2021-04-01 09:24:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:24:20 [DEBUG   ] Got command RPT from MCS: ref #13875
2021-04-01 09:24:20 [DEBUG   ] summary = ERROR
2021-04-01 09:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13875  13 59305 33860509 A  ERRORERROR'
2021-04-01 09:24:20 [DEBUG   ] Got command RPT from MCS: ref #13876
2021-04-01 09:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13876  77 59305 33860509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:24:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:24:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:24:55 [DEBUG   ] Got command RPT from MCS: ref #13893
2021-04-01 09:24:55 [DEBUG   ] summary = ERROR
2021-04-01 09:24:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13893  13 59305 33895981 A  ERRORERROR'
2021-04-01 09:24:56 [DEBUG   ] Got command RPT from MCS: ref #13895
2021-04-01 09:24:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13895  77 59305 33896185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:24:56 [DEBUG   ] Got command RPT from MCS: ref #13897
2021-04-01 09:24:56 [DEBUG   ] summary = ERROR
2021-04-01 09:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13897  13 59305 33896389 A  ERRORERROR'
2021-04-01 09:24:56 [DEBUG   ] Got command RPT from MCS: ref #13899
2021-04-01 09:24:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13899  77 59305 33896581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:24:56 [DEBUG   ] Got command RPT from MCS: ref #13901
2021-04-01 09:24:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13901  12 59305 33896785 A  ERRORB£ff'
2021-04-01 09:25:03 [DEBUG   ] Got command BAM from MCS: ref #13904
2021-04-01 09:25:03 [INFO    ] Finished processing BAM request
2021-04-01 09:25:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13904   8 59305 33903029 A  ERROR'
2021-04-01 09:25:03 [DEBUG   ] Got command BAM from MCS: ref #13903
2021-04-01 09:25:03 [INFO    ] Finished processing BAM request
2021-04-01 09:25:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:25:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13903   8 59305 33903033 A  ERROR'
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:25:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:25:03 [DEBUG   ] spawn_process: at 2021-04-01 09:25:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:25:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 09:25:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:25:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:25:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 09:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:25:08 [DEBUG   ] Finished updating board flags in 1.355 seconds
2021-04-01 09:25:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:25:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:25:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:25:53 [DEBUG   ] Got command BAM from MCS: ref #13905
2021-04-01 09:25:53 [INFO    ] Finished processing BAM request
2021-04-01 09:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13905   8 59305 33953029 A  ERROR'
2021-04-01 09:25:53 [DEBUG   ] Got command BAM from MCS: ref #13906
2021-04-01 09:25:53 [INFO    ] Finished processing BAM request
2021-04-01 09:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13906   8 59305 33953033 A  ERROR'
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:25:53 [DEBUG   ] spawn_process: at 2021-04-01 09:25:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 09:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:26:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:26:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:26:08 [DEBUG   ] Finished updating board flags in 1.217 seconds
2021-04-01 09:26:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:26:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:26:43 [DEBUG   ] Got command BAM from MCS: ref #13908
2021-04-01 09:26:43 [INFO    ] Finished processing BAM request
2021-04-01 09:26:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13908   8 59305 34003029 A  ERROR'
2021-04-01 09:26:43 [DEBUG   ] Got command BAM from MCS: ref #13907
2021-04-01 09:26:43 [INFO    ] Finished processing BAM request
2021-04-01 09:26:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:26:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13907   8 59305 34003033 A  ERROR'
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 09:26:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 09:26:43 [DEBUG   ] spawn_process: at 2021-04-01 09:26:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 09:26:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:27:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:27:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 09:27:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:27:08 [DEBUG   ] Finished updating board flags in 1.218 seconds
2021-04-01 09:27:09 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-04-01 09:27:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:27:33 [DEBUG   ] Got command BAM from MCS: ref #13910
2021-04-01 09:27:33 [INFO    ] Finished processing BAM request
2021-04-01 09:27:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13910   8 59305 34053029 A  ERROR'
2021-04-01 09:27:33 [DEBUG   ] Got command BAM from MCS: ref #13909
2021-04-01 09:27:33 [INFO    ] Finished processing BAM request
2021-04-01 09:27:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:27:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13909   8 59305 34053033 A  ERROR'
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 09:27:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 09:27:33 [DEBUG   ] spawn_process: at 2021-04-01 09:27:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 09:27:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 09:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2021-04-01 09:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 09:28:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:28:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 09:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:28:08 [DEBUG   ] Finished updating board flags in 1.162 seconds
2021-04-01 09:28:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:28:23 [DEBUG   ] Got command BAM from MCS: ref #13917
2021-04-01 09:28:23 [INFO    ] Finished processing BAM request
2021-04-01 09:28:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13917   8 59305 34103033 A  ERROR'
2021-04-01 09:28:23 [DEBUG   ] Got command BAM from MCS: ref #13918
2021-04-01 09:28:23 [INFO    ] Finished processing BAM request
2021-04-01 09:28:23 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13918   8 59305 34103037 A  ERROR'
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:28:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:28:23 [DEBUG   ] spawn_process: at 2021-04-01 09:28:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:28:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:28:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-04-01 09:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 09:29:08 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 09:29:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 09:29:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:29:08 [DEBUG   ] Finished updating board flags in 1.040 seconds
2021-04-01 09:29:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 09:29:13 [DEBUG   ] Got command BAM from MCS: ref #13919
2021-04-01 09:29:13 [INFO    ] Finished processing BAM request
2021-04-01 09:29:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13919   8 59305 34153025 A  ERROR'
2021-04-01 09:29:13 [DEBUG   ] Got command BAM from MCS: ref #13920
2021-04-01 09:29:13 [INFO    ] Finished processing BAM request
2021-04-01 09:29:13 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:29:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13920   8 59305 34153029 A  ERROR'
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:29:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:29:13 [DEBUG   ] spawn_process: at 2021-04-01 09:29:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:29:20 [DEBUG   ] Got command RPT from MCS: ref #13921
2021-04-01 09:29:20 [DEBUG   ] summary = ERROR
2021-04-01 09:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13921  13 59305 34160501 A  ERRORERROR'
2021-04-01 09:29:20 [DEBUG   ] Got command RPT from MCS: ref #13922
2021-04-01 09:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13922  77 59305 34160501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:29:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 09:29:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:29:56 [DEBUG   ] Got command RPT from MCS: ref #13940
2021-04-01 09:29:56 [DEBUG   ] summary = ERROR
2021-04-01 09:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13940  13 59305 34196057 A  ERRORERROR'
2021-04-01 09:29:56 [DEBUG   ] Got command RPT from MCS: ref #13941
2021-04-01 09:29:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13941  77 59305 34196261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:29:56 [DEBUG   ] Got command RPT from MCS: ref #13942
2021-04-01 09:29:56 [DEBUG   ] summary = ERROR
2021-04-01 09:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13942  13 59305 34196453 A  ERRORERROR'
2021-04-01 09:29:56 [DEBUG   ] Got command RPT from MCS: ref #13943
2021-04-01 09:29:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13943  77 59305 34196657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:29:56 [DEBUG   ] Got command RPT from MCS: ref #13945
2021-04-01 09:29:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13945  12 59305 34196861 A  ERRORB¥ff'
2021-04-01 09:30:03 [DEBUG   ] Got command BAM from MCS: ref #13951
2021-04-01 09:30:03 [INFO    ] Finished processing BAM request
2021-04-01 09:30:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13951   8 59305 34203033 A  ERROR'
2021-04-01 09:30:03 [DEBUG   ] Got command BAM from MCS: ref #13950
2021-04-01 09:30:03 [INFO    ] Finished processing BAM request
2021-04-01 09:30:03 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:30:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13950   8 59305 34203037 A  ERROR'
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 09:30:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 09:30:03 [DEBUG   ] spawn_process: at 2021-04-01 09:30:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 09:30:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:30:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:30:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:30:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 09:30:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:30:09 [DEBUG   ] Finished updating board flags in 2.038 seconds
2021-04-01 09:30:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 09:30:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 09:30:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:30:53 [DEBUG   ] Got command BAM from MCS: ref #13953
2021-04-01 09:30:53 [INFO    ] Finished processing BAM request
2021-04-01 09:30:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:30:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13953   8 59305 34253033 A  ERROR'
2021-04-01 09:30:53 [DEBUG   ] Got command BAM from MCS: ref #13952
2021-04-01 09:30:53 [INFO    ] Finished processing BAM request
2021-04-01 09:30:53 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:30:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13952   8 59305 34253037 A  ERROR'
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 09:30:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 09:30:53 [DEBUG   ] spawn_process: at 2021-04-01 09:30:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 09:31:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:31:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:31:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:31:08 [DEBUG   ] Finished updating board flags in 1.376 seconds
2021-04-01 09:31:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:31:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:31:43 [DEBUG   ] Got command BAM from MCS: ref #13960
2021-04-01 09:31:43 [INFO    ] Finished processing BAM request
2021-04-01 09:31:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13960   8 59305 34303033 A  ERROR'
2021-04-01 09:31:43 [DEBUG   ] Got command BAM from MCS: ref #13961
2021-04-01 09:31:43 [INFO    ] Finished processing BAM request
2021-04-01 09:31:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 09:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    13961   8 59305 34303037 A  ERROR'
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 09:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 09:31:43 [DEBUG   ] spawn_process: at 2021-04-01 09:31:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 09:31:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:32:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 09:32:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:32:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 09:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:32:08 [DEBUG   ] Finished updating board flags in 1.250 seconds
2021-04-01 09:32:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:32:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:32:35 [DEBUG   ] Got command STP from MCS: ref #13962
2021-04-01 09:32:35 [INFO    ] Finished processing BAM request
2021-04-01 09:32:35 [INFO    ] Shutdown the adder chain on beam #2
2021-04-01 09:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    13962   8 59305 34355024 A  ERROR'
2021-04-01 09:32:35 [DEBUG   ] Got command STP from MCS: ref #13963
2021-04-01 09:32:35 [INFO    ] Finished processing BAM request
2021-04-01 09:32:35 [INFO    ] Shutdown the adder chain on beam #4
2021-04-01 09:32:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    13963   8 59305 34355028 A  ERROR'
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 09:32:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 09:32:35 [DEBUG   ] spawn_process: at 2021-04-01 09:32:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 09:32:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:33:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 09:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:33:08 [DEBUG   ] Finished updating board flags in 1.210 seconds
2021-04-01 09:33:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:33:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:33:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:34:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:34:08 [DEBUG   ] Finished updating board flags in 1.146 seconds
2021-04-01 09:34:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:34:20 [DEBUG   ] Got command RPT from MCS: ref #13970
2021-04-01 09:34:20 [DEBUG   ] summary = ERROR
2021-04-01 09:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13970  13 59305 34460509 A  ERRORERROR'
2021-04-01 09:34:20 [DEBUG   ] Got command RPT from MCS: ref #13971
2021-04-01 09:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13971  77 59305 34460509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:34:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:34:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:34:56 [DEBUG   ] Got command RPT from MCS: ref #13987
2021-04-01 09:34:56 [DEBUG   ] summary = ERROR
2021-04-01 09:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13987  13 59305 34496125 A  ERRORERROR'
2021-04-01 09:34:56 [DEBUG   ] Got command RPT from MCS: ref #13988
2021-04-01 09:34:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13988  77 59305 34496329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:34:56 [DEBUG   ] Got command RPT from MCS: ref #13989
2021-04-01 09:34:56 [DEBUG   ] summary = ERROR
2021-04-01 09:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13989  13 59305 34496533 A  ERRORERROR'
2021-04-01 09:34:56 [DEBUG   ] Got command RPT from MCS: ref #13990
2021-04-01 09:34:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13990  77 59305 34496725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:34:56 [DEBUG   ] Got command RPT from MCS: ref #13991
2021-04-01 09:34:56 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13991  12 59305 34496929 A  ERRORBžff'
2021-04-01 09:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:35:09 [DEBUG   ] Finished updating board flags in 1.606 seconds
2021-04-01 09:35:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:35:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:35:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:36:08 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:36:08 [DEBUG   ] Finished updating board flags in 1.033 seconds
2021-04-01 09:36:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:36:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:36:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:37:09 [DEBUG   ] Finished updating board flags in 1.546 seconds
2021-04-01 09:37:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:37:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:37:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:38:09 [DEBUG   ] Finished updating board flags in 1.393 seconds
2021-04-01 09:38:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:38:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:38:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:39:09 [DEBUG   ] Finished updating board flags in 1.235 seconds
2021-04-01 09:39:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:39:20 [DEBUG   ] Got command RPT from MCS: ref #13998
2021-04-01 09:39:20 [DEBUG   ] summary = ERROR
2021-04-01 09:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13998  13 59305 34760505 A  ERRORERROR'
2021-04-01 09:39:20 [DEBUG   ] Got command RPT from MCS: ref #13999
2021-04-01 09:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    13999  77 59305 34760505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:39:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:39:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:39:56 [DEBUG   ] Got command RPT from MCS: ref #14018
2021-04-01 09:39:56 [DEBUG   ] summary = ERROR
2021-04-01 09:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14018  13 59305 34796201 A  ERRORERROR'
2021-04-01 09:39:56 [DEBUG   ] Got command RPT from MCS: ref #14020
2021-04-01 09:39:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14020  77 59305 34796405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:39:56 [DEBUG   ] Got command RPT from MCS: ref #14022
2021-04-01 09:39:56 [DEBUG   ] summary = ERROR
2021-04-01 09:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14022  13 59305 34796597 A  ERRORERROR'
2021-04-01 09:39:56 [DEBUG   ] Got command RPT from MCS: ref #14024
2021-04-01 09:39:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:39:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14024  77 59305 34796801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:39:57 [DEBUG   ] Got command RPT from MCS: ref #14027
2021-04-01 09:39:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14027  12 59305 34797005 A  ERRORB™™š'
2021-04-01 09:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:40:09 [DEBUG   ] Finished updating board flags in 1.248 seconds
2021-04-01 09:40:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:40:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:40:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:41:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:41:09 [DEBUG   ] Finished updating board flags in 1.116 seconds
2021-04-01 09:41:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:41:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 09:41:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 09:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:42:09 [DEBUG   ] Finished updating board flags in 1.017 seconds
2021-04-01 09:42:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 09:42:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 09:42:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 09:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2021-04-01 09:43:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:43:10 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2021-04-01 09:43:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:43:10 [DEBUG   ] Finished updating board flags in 2.047 seconds
2021-04-01 09:43:30 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 09:43:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:44:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:44:09 [DEBUG   ] Finished updating board flags in 1.403 seconds
2021-04-01 09:44:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:44:20 [DEBUG   ] Got command RPT from MCS: ref #14039
2021-04-01 09:44:20 [DEBUG   ] summary = ERROR
2021-04-01 09:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14039  13 59305 35060509 A  ERRORERROR'
2021-04-01 09:44:20 [DEBUG   ] Got command RPT from MCS: ref #14040
2021-04-01 09:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14040  77 59305 35060509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:44:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:44:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:44:56 [DEBUG   ] Got command RPT from MCS: ref #14056
2021-04-01 09:44:56 [DEBUG   ] summary = ERROR
2021-04-01 09:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14056  13 59305 35096269 A  ERRORERROR'
2021-04-01 09:44:56 [DEBUG   ] Got command RPT from MCS: ref #14057
2021-04-01 09:44:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14057  77 59305 35096473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:44:56 [DEBUG   ] Got command RPT from MCS: ref #14058
2021-04-01 09:44:56 [DEBUG   ] summary = ERROR
2021-04-01 09:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14058  13 59305 35096677 A  ERRORERROR'
2021-04-01 09:44:56 [DEBUG   ] Got command RPT from MCS: ref #14059
2021-04-01 09:44:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:44:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14059  77 59305 35096869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:44:57 [DEBUG   ] Got command RPT from MCS: ref #14060
2021-04-01 09:44:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14060  12 59305 35097073 A  ERRORBš™š'
2021-04-01 09:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 09:45:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:45:09 [DEBUG   ] Finished updating board flags in 1.451 seconds
2021-04-01 09:45:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:45:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:45:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:46:09 [DEBUG   ] Finished updating board flags in 1.406 seconds
2021-04-01 09:46:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:46:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:46:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:47:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:47:09 [DEBUG   ] Finished updating board flags in 1.355 seconds
2021-04-01 09:47:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:47:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 09:47:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 09:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:48:10 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2021-04-01 09:48:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:48:10 [DEBUG   ] Finished updating board flags in 1.824 seconds
2021-04-01 09:48:30 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2021-04-01 09:48:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 09:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:49:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:49:09 [DEBUG   ] Finished updating board flags in 1.144 seconds
2021-04-01 09:49:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:49:20 [DEBUG   ] Got command RPT from MCS: ref #14073
2021-04-01 09:49:20 [DEBUG   ] summary = ERROR
2021-04-01 09:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14073  13 59305 35360505 A  ERRORERROR'
2021-04-01 09:49:20 [DEBUG   ] Got command RPT from MCS: ref #14074
2021-04-01 09:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14074  77 59305 35360505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:49:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:49:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 09:49:56 [DEBUG   ] Got command RPT from MCS: ref #14092
2021-04-01 09:49:56 [DEBUG   ] summary = ERROR
2021-04-01 09:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14092  13 59305 35396341 A  ERRORERROR'
2021-04-01 09:49:56 [DEBUG   ] Got command RPT from MCS: ref #14093
2021-04-01 09:49:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14093  77 59305 35396545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:49:56 [DEBUG   ] Got command RPT from MCS: ref #14094
2021-04-01 09:49:56 [DEBUG   ] summary = ERROR
2021-04-01 09:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14094  13 59305 35396749 A  ERRORERROR'
2021-04-01 09:49:56 [DEBUG   ] Got command RPT from MCS: ref #14095
2021-04-01 09:49:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14095  77 59305 35396941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:49:57 [DEBUG   ] Got command RPT from MCS: ref #14097
2021-04-01 09:49:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14097  12 59305 35397145 A  ERRORBš™š'
2021-04-01 09:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:50:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:50:10 [DEBUG   ] Finished updating board flags in 1.614 seconds
2021-04-01 09:50:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:50:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:50:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 09:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:51:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:51:09 [DEBUG   ] Finished updating board flags in 1.000 seconds
2021-04-01 09:51:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 09:51:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:51:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:52:09 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:52:09 [DEBUG   ] Finished updating board flags in 1.028 seconds
2021-04-01 09:52:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 09:52:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:52:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:53:10 [DEBUG   ] Finished updating board flags in 1.557 seconds
2021-04-01 09:53:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:53:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:53:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:54:10 [DEBUG   ] Finished updating board flags in 1.433 seconds
2021-04-01 09:54:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 09:54:20 [DEBUG   ] Got command RPT from MCS: ref #14108
2021-04-01 09:54:20 [DEBUG   ] summary = ERROR
2021-04-01 09:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14108  13 59305 35660509 A  ERRORERROR'
2021-04-01 09:54:20 [DEBUG   ] Got command RPT from MCS: ref #14109
2021-04-01 09:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14109  77 59305 35660509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:54:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 09:54:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 09:54:56 [DEBUG   ] Got command RPT from MCS: ref #14126
2021-04-01 09:54:56 [DEBUG   ] summary = ERROR
2021-04-01 09:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14126  13 59305 35696413 A  ERRORERROR'
2021-04-01 09:54:56 [DEBUG   ] Got command RPT from MCS: ref #14128
2021-04-01 09:54:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14128  77 59305 35696617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:54:56 [DEBUG   ] Got command RPT from MCS: ref #14130
2021-04-01 09:54:56 [DEBUG   ] summary = ERROR
2021-04-01 09:54:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14130  13 59305 35696821 A  ERRORERROR'
2021-04-01 09:54:57 [DEBUG   ] Got command RPT from MCS: ref #14132
2021-04-01 09:54:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14132  77 59305 35697013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:54:57 [DEBUG   ] Got command RPT from MCS: ref #14134
2021-04-01 09:54:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14134  12 59305 35697217 A  ERRORB™™š'
2021-04-01 09:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:55:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 09:55:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:55:11 [DEBUG   ] Finished updating board flags in 2.558 seconds
2021-04-01 09:55:31 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2021-04-01 09:55:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 09:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:56:10 [DEBUG   ] Finished updating board flags in 1.222 seconds
2021-04-01 09:56:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 09:56:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:56:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 09:57:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:57:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 09:57:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:57:11 [DEBUG   ] Finished updating board flags in 2.136 seconds
2021-04-01 09:57:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 09:57:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:58:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:58:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:58:10 [DEBUG   ] Finished updating board flags in 1.028 seconds
2021-04-01 09:58:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:58:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:58:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:59:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 09:59:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 09:59:10 [DEBUG   ] Finished updating board flags in 1.054 seconds
2021-04-01 09:59:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:59:20 [DEBUG   ] Got command RPT from MCS: ref #14142
2021-04-01 09:59:20 [DEBUG   ] summary = ERROR
2021-04-01 09:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14142  13 59305 35960513 A  ERRORERROR'
2021-04-01 09:59:20 [DEBUG   ] Got command RPT from MCS: ref #14143
2021-04-01 09:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14143  77 59305 35960513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:59:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:59:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 09:59:56 [DEBUG   ] Got command RPT from MCS: ref #14161
2021-04-01 09:59:56 [DEBUG   ] summary = ERROR
2021-04-01 09:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14161  13 59305 35996493 A  ERRORERROR'
2021-04-01 09:59:56 [DEBUG   ] Got command RPT from MCS: ref #14162
2021-04-01 09:59:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14162  77 59305 35996685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:59:56 [DEBUG   ] Got command RPT from MCS: ref #14163
2021-04-01 09:59:56 [DEBUG   ] summary = ERROR
2021-04-01 09:59:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14163  13 59305 35996889 A  ERRORERROR'
2021-04-01 09:59:57 [DEBUG   ] Got command RPT from MCS: ref #14164
2021-04-01 09:59:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 09:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14164  77 59305 35997093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 09:59:57 [DEBUG   ] Got command RPT from MCS: ref #14166
2021-04-01 09:59:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 09:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14166  12 59305 35997285 A  ERRORBš™š'
2021-04-01 10:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:00:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:00:11 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2021-04-01 10:00:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:00:11 [DEBUG   ] Finished updating board flags in 2.001 seconds
2021-04-01 10:00:31 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2021-04-01 10:00:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:01:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:01:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:01:11 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2021-04-01 10:01:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:01:11 [DEBUG   ] Finished updating board flags in 2.007 seconds
2021-04-01 10:01:31 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 10:01:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 10:02:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:02:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:02:10 [DEBUG   ] Finished updating board flags in 1.427 seconds
2021-04-01 10:02:11 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 10:02:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 10:02:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:03:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:03:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:03:10 [DEBUG   ] Finished updating board flags in 1.413 seconds
2021-04-01 10:03:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:03:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:03:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:04:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:04:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:04:10 [DEBUG   ] Finished updating board flags in 1.364 seconds
2021-04-01 10:04:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 10:04:20 [DEBUG   ] Got command RPT from MCS: ref #14183
2021-04-01 10:04:20 [DEBUG   ] summary = ERROR
2021-04-01 10:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14183  13 59305 36260509 A  ERRORERROR'
2021-04-01 10:04:20 [DEBUG   ] Got command RPT from MCS: ref #14184
2021-04-01 10:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14184  77 59305 36260509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:04:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:04:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:04:56 [DEBUG   ] Got command RPT from MCS: ref #14200
2021-04-01 10:04:56 [DEBUG   ] summary = ERROR
2021-04-01 10:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14200  13 59305 36296565 A  ERRORERROR'
2021-04-01 10:04:56 [DEBUG   ] Got command RPT from MCS: ref #14201
2021-04-01 10:04:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14201  77 59305 36296757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:04:56 [DEBUG   ] Got command RPT from MCS: ref #14202
2021-04-01 10:04:56 [DEBUG   ] summary = ERROR
2021-04-01 10:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14202  13 59305 36296961 A  ERRORERROR'
2021-04-01 10:04:57 [DEBUG   ] Got command RPT from MCS: ref #14203
2021-04-01 10:04:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14203  77 59305 36297165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:04:57 [DEBUG   ] Got command RPT from MCS: ref #14204
2021-04-01 10:04:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14204  12 59305 36297357 A  ERRORBš™š'
2021-04-01 10:05:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:05:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:05:10 [DEBUG   ] Finished updating board flags in 1.252 seconds
2021-04-01 10:05:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:05:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:05:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 10:06:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:06:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 10:06:10 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:06:10 [DEBUG   ] Finished updating board flags in 1.133 seconds
2021-04-01 10:06:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 10:06:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 10:06:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:07:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:07:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 10:07:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:07:12 [DEBUG   ] Finished updating board flags in 2.754 seconds
2021-04-01 10:07:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 10:07:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:08:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:08:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:08:11 [DEBUG   ] Finished updating board flags in 1.454 seconds
2021-04-01 10:08:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:08:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:08:43 [DEBUG   ] Got command DRX from MCS: ref #14216
2021-04-01 10:08:43 [INFO    ] sending drx command to lwa16
2021-04-01 10:08:43 [DEBUG   ] run_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 64500000.0 7 9 0']
2021-04-01 10:08:43 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 10:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    14216   8 59305 36523005 A  ERROR'
2021-04-01 10:08:43 [DEBUG   ] Got command DRX from MCS: ref #14215
2021-04-01 10:08:43 [INFO    ] sending drx command to lwa16
2021-04-01 10:08:43 [DEBUG   ] run_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35100000.0 7 9 0']
2021-04-01 10:08:43 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 10:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    14215   8 59305 36523009 A  ERROR'
2021-04-01 10:08:43 [DEBUG   ] Got command DRX from MCS: ref #14217
2021-04-01 10:08:43 [INFO    ] sending drx command to lwa16
2021-04-01 10:08:43 [DEBUG   ] run_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 49800000.0 7 9 0']
2021-04-01 10:08:43 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 10:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    14217   8 59305 36523017 A  ERROR'
2021-04-01 10:08:43 [DEBUG   ] Got command DRX from MCS: ref #14218
2021-04-01 10:08:43 [INFO    ] sending drx command to lwa16
2021-04-01 10:08:43 [DEBUG   ] run_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 79200000.0 7 9 0']
2021-04-01 10:08:43 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 10:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    14218   8 59305 36523025 A  ERROR'
2021-04-01 10:08:43 [DEBUG   ] Got command BAM from MCS: ref #14219
2021-04-01 10:08:43 [INFO    ] Finished processing BAM request
2021-04-01 10:08:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14219   8 59305 36523033 A  ERROR'
2021-04-01 10:08:43 [DEBUG   ] Got command BAM from MCS: ref #14220
2021-04-01 10:08:43 [INFO    ] Finished processing BAM request
2021-04-01 10:08:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:08:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14220   8 59305 36523041 A  ERROR'
2021-04-01 10:08:43 [INFO    ] Finished starting DRX
2021-04-01 10:08:43 [INFO    ] Finished starting DRX
2021-04-01 10:08:43 [INFO    ] Finished starting DRX
2021-04-01 10:08:43 [INFO    ] Finished starting DRX
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:08:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:08:43 [DEBUG   ] spawn_process: at 2021-04-01 10:08:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:08:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:09:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:09:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:09:11 [DEBUG   ] Finished updating board flags in 1.408 seconds
2021-04-01 10:09:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:09:20 [DEBUG   ] Got command RPT from MCS: ref #14223
2021-04-01 10:09:20 [DEBUG   ] summary = ERROR
2021-04-01 10:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14223  13 59305 36560521 A  ERRORERROR'
2021-04-01 10:09:20 [DEBUG   ] Got command RPT from MCS: ref #14224
2021-04-01 10:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14224  77 59305 36560521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:09:31 [DEBUG   ] Got command BAM from MCS: ref #14241
2021-04-01 10:09:31 [INFO    ] Finished processing BAM request
2021-04-01 10:09:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14241   8 59305 36571025 A  ERROR'
2021-04-01 10:09:31 [DEBUG   ] Got command BAM from MCS: ref #14240
2021-04-01 10:09:31 [INFO    ] Finished processing BAM request
2021-04-01 10:09:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14240   8 59305 36571029 A  ERROR'
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:09:31 [DEBUG   ] spawn_process: at 2021-04-01 10:09:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:09:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:09:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:09:56 [DEBUG   ] Got command RPT from MCS: ref #14245
2021-04-01 10:09:56 [DEBUG   ] summary = ERROR
2021-04-01 10:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14245  13 59305 36596637 A  ERRORERROR'
2021-04-01 10:09:56 [DEBUG   ] Got command RPT from MCS: ref #14247
2021-04-01 10:09:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:09:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14247  77 59305 36596829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:09:57 [DEBUG   ] Got command RPT from MCS: ref #14249
2021-04-01 10:09:57 [DEBUG   ] summary = ERROR
2021-04-01 10:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14249  13 59305 36597033 A  ERRORERROR'
2021-04-01 10:09:57 [DEBUG   ] Got command RPT from MCS: ref #14251
2021-04-01 10:09:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14251  77 59305 36597237 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:09:57 [DEBUG   ] Got command RPT from MCS: ref #14254
2021-04-01 10:09:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14254  12 59305 36597441 A  ERRORB�ff'
2021-04-01 10:10:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:10:11 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:10:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 10:10:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:10:12 [DEBUG   ] Finished updating board flags in 2.304 seconds
2021-04-01 10:10:19 [DEBUG   ] Got command BAM from MCS: ref #14261
2021-04-01 10:10:19 [INFO    ] Finished processing BAM request
2021-04-01 10:10:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14261   8 59305 36619025 A  ERROR'
2021-04-01 10:10:19 [DEBUG   ] Got command BAM from MCS: ref #14260
2021-04-01 10:10:19 [INFO    ] Finished processing BAM request
2021-04-01 10:10:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14260   8 59305 36619029 A  ERROR'
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:10:19 [DEBUG   ] spawn_process: at 2021-04-01 10:10:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:10:32 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 10:10:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:11:07 [DEBUG   ] Got command BAM from MCS: ref #14263
2021-04-01 10:11:07 [INFO    ] Finished processing BAM request
2021-04-01 10:11:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14263   8 59305 36667025 A  ERROR'
2021-04-01 10:11:07 [DEBUG   ] Got command BAM from MCS: ref #14262
2021-04-01 10:11:07 [INFO    ] Finished processing BAM request
2021-04-01 10:11:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14262   8 59305 36667029 A  ERROR'
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 10:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 10:11:07 [DEBUG   ] spawn_process: at 2021-04-01 10:11:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 10:11:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:11:11 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:11:11 [DEBUG   ] Finished updating board flags in 1.258 seconds
2021-04-01 10:11:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:11:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:11:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:11:55 [DEBUG   ] Got command BAM from MCS: ref #14265
2021-04-01 10:11:55 [INFO    ] Finished processing BAM request
2021-04-01 10:11:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14265   8 59305 36715025 A  ERROR'
2021-04-01 10:11:55 [DEBUG   ] Got command BAM from MCS: ref #14264
2021-04-01 10:11:55 [INFO    ] Finished processing BAM request
2021-04-01 10:11:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:11:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14264   8 59305 36715029 A  ERROR'
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 10:11:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 10:11:55 [DEBUG   ] spawn_process: at 2021-04-01 10:11:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 10:12:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2021-04-01 10:12:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:12:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:12:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:12:11 [DEBUG   ] Finished updating board flags in 1.202 seconds
2021-04-01 10:12:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:12:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:12:43 [DEBUG   ] Got command BAM from MCS: ref #14267
2021-04-01 10:12:43 [INFO    ] Finished processing BAM request
2021-04-01 10:12:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14267   8 59305 36763029 A  ERROR'
2021-04-01 10:12:43 [DEBUG   ] Got command BAM from MCS: ref #14266
2021-04-01 10:12:43 [INFO    ] Finished processing BAM request
2021-04-01 10:12:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:12:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14266   8 59305 36763033 A  ERROR'
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:12:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:12:43 [DEBUG   ] spawn_process: at 2021-04-01 10:12:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:12:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:13:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:13:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:13:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:13:11 [DEBUG   ] Finished updating board flags in 1.237 seconds
2021-04-01 10:13:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 10:13:31 [DEBUG   ] Got command BAM from MCS: ref #14275
2021-04-01 10:13:31 [INFO    ] Finished processing BAM request
2021-04-01 10:13:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14275   8 59305 36811025 A  ERROR'
2021-04-01 10:13:31 [DEBUG   ] Got command BAM from MCS: ref #14274
2021-04-01 10:13:31 [INFO    ] Finished processing BAM request
2021-04-01 10:13:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14274   8 59305 36811029 A  ERROR'
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:13:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:13:31 [DEBUG   ] spawn_process: at 2021-04-01 10:13:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:13:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:13:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:14:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-04-01 10:14:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:14:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:14:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:14:11 [DEBUG   ] Finished updating board flags in 1.468 seconds
2021-04-01 10:14:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:14:19 [DEBUG   ] Got command BAM from MCS: ref #14277
2021-04-01 10:14:19 [INFO    ] Finished processing BAM request
2021-04-01 10:14:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14277   8 59305 36859025 A  ERROR'
2021-04-01 10:14:19 [DEBUG   ] Got command BAM from MCS: ref #14276
2021-04-01 10:14:19 [INFO    ] Finished processing BAM request
2021-04-01 10:14:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:14:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14276   8 59305 36859029 A  ERROR'
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:14:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:14:19 [DEBUG   ] spawn_process: at 2021-04-01 10:14:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:14:20 [DEBUG   ] Got command RPT from MCS: ref #14278
2021-04-01 10:14:20 [DEBUG   ] summary = ERROR
2021-04-01 10:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14278  13 59305 36860517 A  ERRORERROR'
2021-04-01 10:14:20 [DEBUG   ] Got command RPT from MCS: ref #14279
2021-04-01 10:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14279  77 59305 36860517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:14:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:14:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:14:56 [DEBUG   ] Got command RPT from MCS: ref #14295
2021-04-01 10:14:56 [DEBUG   ] summary = ERROR
2021-04-01 10:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14295  13 59305 36896709 A  ERRORERROR'
2021-04-01 10:14:56 [DEBUG   ] Got command RPT from MCS: ref #14296
2021-04-01 10:14:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:14:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14296  77 59305 36896901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:14:57 [DEBUG   ] Got command RPT from MCS: ref #14297
2021-04-01 10:14:57 [DEBUG   ] summary = ERROR
2021-04-01 10:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14297  13 59305 36897105 A  ERRORERROR'
2021-04-01 10:14:57 [DEBUG   ] Got command RPT from MCS: ref #14298
2021-04-01 10:14:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14298  77 59305 36897309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:14:57 [DEBUG   ] Got command RPT from MCS: ref #14299
2021-04-01 10:14:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14299  12 59305 36897513 A  ERRORB¢ff'
2021-04-01 10:15:07 [DEBUG   ] Got command BAM from MCS: ref #14301
2021-04-01 10:15:07 [INFO    ] Finished processing BAM request
2021-04-01 10:15:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14301   8 59305 36907025 A  ERROR'
2021-04-01 10:15:07 [DEBUG   ] Got command BAM from MCS: ref #14300
2021-04-01 10:15:07 [INFO    ] Finished processing BAM request
2021-04-01 10:15:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:15:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14300   8 59305 36907029 A  ERROR'
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:15:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:15:07 [DEBUG   ] spawn_process: at 2021-04-01 10:15:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:15:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2021-04-01 10:15:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:15:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 10:15:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:15:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:15:11 [DEBUG   ] Finished updating board flags in 1.087 seconds
2021-04-01 10:15:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:15:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:15:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:15:55 [DEBUG   ] Got command BAM from MCS: ref #14302
2021-04-01 10:15:55 [INFO    ] Finished processing BAM request
2021-04-01 10:15:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:15:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14302   8 59305 36955033 A  ERROR'
2021-04-01 10:15:55 [DEBUG   ] Got command BAM from MCS: ref #14303
2021-04-01 10:15:55 [INFO    ] Finished processing BAM request
2021-04-01 10:15:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:15:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14303   8 59305 36955037 A  ERROR'
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:15:55 [DEBUG   ] spawn_process: at 2021-04-01 10:15:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:16:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-04-01 10:16:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:16:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:16:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:16:11 [DEBUG   ] Finished updating board flags in 1.022 seconds
2021-04-01 10:16:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:16:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:16:43 [DEBUG   ] Got command BAM from MCS: ref #14310
2021-04-01 10:16:43 [INFO    ] Finished processing BAM request
2021-04-01 10:16:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14310   8 59305 37003025 A  ERROR'
2021-04-01 10:16:43 [DEBUG   ] Got command BAM from MCS: ref #14311
2021-04-01 10:16:43 [INFO    ] Finished processing BAM request
2021-04-01 10:16:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:16:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14311   8 59305 37003029 A  ERROR'
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:16:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:16:43 [DEBUG   ] spawn_process: at 2021-04-01 10:16:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:16:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:17:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:17:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:17:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:17:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:17:11 [DEBUG   ] Finished updating board flags in 1.031 seconds
2021-04-01 10:17:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:17:31 [DEBUG   ] Got command BAM from MCS: ref #14312
2021-04-01 10:17:31 [INFO    ] Finished processing BAM request
2021-04-01 10:17:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14312   8 59305 37051029 A  ERROR'
2021-04-01 10:17:31 [DEBUG   ] Got command BAM from MCS: ref #14313
2021-04-01 10:17:31 [INFO    ] Finished processing BAM request
2021-04-01 10:17:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:17:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14313   8 59305 37051033 A  ERROR'
2021-04-01 10:17:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 10:17:31 [DEBUG   ] spawn_process: at 2021-04-01 10:17:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 10:17:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 10:17:32 [DEBUG   ] spawn_process: at 2021-04-01 10:17:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 10:17:33 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2021-04-01 10:17:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:18:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 10:18:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:18:12 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2021-04-01 10:18:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:18:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:18:12 [DEBUG   ] Finished updating board flags in 2.025 seconds
2021-04-01 10:18:19 [DEBUG   ] Got command BAM from MCS: ref #14315
2021-04-01 10:18:19 [INFO    ] Finished processing BAM request
2021-04-01 10:18:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14315   8 59305 37099033 A  ERROR'
2021-04-01 10:18:19 [DEBUG   ] Got command BAM from MCS: ref #14314
2021-04-01 10:18:19 [INFO    ] Finished processing BAM request
2021-04-01 10:18:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14314   8 59305 37099037 A  ERROR'
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 10:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 10:18:19 [DEBUG   ] spawn_process: at 2021-04-01 10:18:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 10:18:32 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2021-04-01 10:18:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 10:19:07 [DEBUG   ] Got command BAM from MCS: ref #14323
2021-04-01 10:19:07 [INFO    ] Finished processing BAM request
2021-04-01 10:19:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14323   8 59305 37147033 A  ERROR'
2021-04-01 10:19:07 [DEBUG   ] Got command BAM from MCS: ref #14322
2021-04-01 10:19:07 [INFO    ] Finished processing BAM request
2021-04-01 10:19:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:19:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14322   8 59305 37147037 A  ERROR'
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:19:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:19:07 [DEBUG   ] spawn_process: at 2021-04-01 10:19:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:19:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:19:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 10:19:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:19:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:19:11 [DEBUG   ] Finished updating board flags in 1.410 seconds
2021-04-01 10:19:12 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-04-01 10:19:20 [DEBUG   ] Got command RPT from MCS: ref #14324
2021-04-01 10:19:20 [DEBUG   ] summary = ERROR
2021-04-01 10:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14324  13 59305 37160513 A  ERRORERROR'
2021-04-01 10:19:20 [DEBUG   ] Got command RPT from MCS: ref #14325
2021-04-01 10:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14325  77 59305 37160513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:19:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:19:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:19:55 [DEBUG   ] Got command BAM from MCS: ref #14341
2021-04-01 10:19:55 [INFO    ] Finished processing BAM request
2021-04-01 10:19:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14341   8 59305 37195033 A  ERROR'
2021-04-01 10:19:55 [DEBUG   ] Got command BAM from MCS: ref #14342
2021-04-01 10:19:55 [INFO    ] Finished processing BAM request
2021-04-01 10:19:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14342   8 59305 37195037 A  ERROR'
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:19:55 [DEBUG   ] spawn_process: at 2021-04-01 10:19:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:19:56 [DEBUG   ] Got command RPT from MCS: ref #14345
2021-04-01 10:19:56 [DEBUG   ] summary = ERROR
2021-04-01 10:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14345  13 59305 37196777 A  ERRORERROR'
2021-04-01 10:19:56 [DEBUG   ] Got command RPT from MCS: ref #14346
2021-04-01 10:19:56 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:19:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14346  77 59305 37196981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:19:57 [DEBUG   ] Got command RPT from MCS: ref #14347
2021-04-01 10:19:57 [DEBUG   ] summary = ERROR
2021-04-01 10:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14347  13 59305 37197185 A  ERRORERROR'
2021-04-01 10:19:57 [DEBUG   ] Got command RPT from MCS: ref #14348
2021-04-01 10:19:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14348  77 59305 37197377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:19:57 [DEBUG   ] Got command RPT from MCS: ref #14350
2021-04-01 10:19:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14350  12 59305 37197581 A  ERRORB£ff'
2021-04-01 10:20:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:20:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:20:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:20:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:20:11 [DEBUG   ] Finished updating board flags in 1.416 seconds
2021-04-01 10:20:13 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2021-04-01 10:20:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:20:43 [DEBUG   ] Got command BAM from MCS: ref #14355
2021-04-01 10:20:43 [INFO    ] Finished processing BAM request
2021-04-01 10:20:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:20:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14355   8 59305 37243029 A  ERROR'
2021-04-01 10:20:43 [DEBUG   ] Got command BAM from MCS: ref #14356
2021-04-01 10:20:43 [INFO    ] Finished processing BAM request
2021-04-01 10:20:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:20:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14356   8 59305 37243033 A  ERROR'
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 10:20:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 10:20:43 [DEBUG   ] spawn_process: at 2021-04-01 10:20:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 10:20:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:21:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:21:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:21:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:21:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:21:11 [DEBUG   ] Finished updating board flags in 1.382 seconds
2021-04-01 10:21:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:21:31 [DEBUG   ] Got command BAM from MCS: ref #14357
2021-04-01 10:21:31 [INFO    ] Finished processing BAM request
2021-04-01 10:21:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:21:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14357   8 59305 37291025 A  ERROR'
2021-04-01 10:21:31 [DEBUG   ] Got command BAM from MCS: ref #14358
2021-04-01 10:21:31 [INFO    ] Finished processing BAM request
2021-04-01 10:21:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:21:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14358   8 59305 37291029 A  ERROR'
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:21:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:21:31 [DEBUG   ] spawn_process: at 2021-04-01 10:21:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:21:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:21:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:22:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 10:22:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:22:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:22:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:22:11 [DEBUG   ] Finished updating board flags in 1.251 seconds
2021-04-01 10:22:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:22:19 [DEBUG   ] Got command BAM from MCS: ref #14365
2021-04-01 10:22:19 [INFO    ] Finished processing BAM request
2021-04-01 10:22:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14365   8 59305 37339025 A  ERROR'
2021-04-01 10:22:19 [DEBUG   ] Got command BAM from MCS: ref #14366
2021-04-01 10:22:19 [INFO    ] Finished processing BAM request
2021-04-01 10:22:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:22:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14366   8 59305 37339029 A  ERROR'
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:22:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:22:19 [DEBUG   ] spawn_process: at 2021-04-01 10:22:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:22:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:22:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:23:07 [DEBUG   ] Got command BAM from MCS: ref #14367
2021-04-01 10:23:07 [INFO    ] Finished processing BAM request
2021-04-01 10:23:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14367   8 59305 37387037 A  ERROR'
2021-04-01 10:23:07 [DEBUG   ] Got command BAM from MCS: ref #14368
2021-04-01 10:23:07 [INFO    ] Finished processing BAM request
2021-04-01 10:23:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:23:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14368   8 59305 37387041 A  ERROR'
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:23:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:23:07 [DEBUG   ] spawn_process: at 2021-04-01 10:23:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:23:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:23:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:23:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:23:11 [DEBUG   ] Finished updating board flags in 1.126 seconds
2021-04-01 10:23:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:23:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:23:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:23:55 [DEBUG   ] Got command BAM from MCS: ref #14369
2021-04-01 10:23:55 [INFO    ] Finished processing BAM request
2021-04-01 10:23:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14369   8 59305 37435025 A  ERROR'
2021-04-01 10:23:55 [DEBUG   ] Got command BAM from MCS: ref #14370
2021-04-01 10:23:55 [INFO    ] Finished processing BAM request
2021-04-01 10:23:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:23:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14370   8 59305 37435029 A  ERROR'
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:23:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:23:55 [DEBUG   ] spawn_process: at 2021-04-01 10:23:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:24:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 10:24:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:24:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:24:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:24:11 [DEBUG   ] Finished updating board flags in 1.036 seconds
2021-04-01 10:24:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:24:20 [DEBUG   ] Got command RPT from MCS: ref #14371
2021-04-01 10:24:20 [DEBUG   ] summary = ERROR
2021-04-01 10:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14371  13 59305 37460525 A  ERRORERROR'
2021-04-01 10:24:20 [DEBUG   ] Got command RPT from MCS: ref #14372
2021-04-01 10:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14372  77 59305 37460525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:24:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:24:43 [DEBUG   ] Got command BAM from MCS: ref #14389
2021-04-01 10:24:43 [INFO    ] Finished processing BAM request
2021-04-01 10:24:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14389   8 59305 37483029 A  ERROR'
2021-04-01 10:24:43 [DEBUG   ] Got command BAM from MCS: ref #14388
2021-04-01 10:24:43 [INFO    ] Finished processing BAM request
2021-04-01 10:24:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:24:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14388   8 59305 37483033 A  ERROR'
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:24:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:24:43 [DEBUG   ] spawn_process: at 2021-04-01 10:24:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:24:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:24:56 [DEBUG   ] Got command RPT from MCS: ref #14391
2021-04-01 10:24:56 [DEBUG   ] summary = ERROR
2021-04-01 10:24:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14391  13 59305 37496853 A  ERRORERROR'
2021-04-01 10:24:57 [DEBUG   ] Got command RPT from MCS: ref #14393
2021-04-01 10:24:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14393  77 59305 37497057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:24:57 [DEBUG   ] Got command RPT from MCS: ref #14395
2021-04-01 10:24:57 [DEBUG   ] summary = ERROR
2021-04-01 10:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14395  13 59305 37497249 A  ERRORERROR'
2021-04-01 10:24:57 [DEBUG   ] Got command RPT from MCS: ref #14397
2021-04-01 10:24:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14397  77 59305 37497453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:24:57 [DEBUG   ] Got command RPT from MCS: ref #14399
2021-04-01 10:24:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14399  12 59305 37497657 A  ERRORB£ff'
2021-04-01 10:25:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 10:25:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:25:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 10:25:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:25:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 10:25:11 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:25:11 [DEBUG   ] Finished updating board flags in 0.997 seconds
2021-04-01 10:25:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:25:31 [DEBUG   ] Got command BAM from MCS: ref #14402
2021-04-01 10:25:31 [INFO    ] Finished processing BAM request
2021-04-01 10:25:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14402   8 59305 37531025 A  ERROR'
2021-04-01 10:25:31 [DEBUG   ] Got command BAM from MCS: ref #14401
2021-04-01 10:25:31 [INFO    ] Finished processing BAM request
2021-04-01 10:25:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:25:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14401   8 59305 37531029 A  ERROR'
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:25:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:25:31 [DEBUG   ] spawn_process: at 2021-04-01 10:25:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:25:33 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 10:25:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:26:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 10:26:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:26:12 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:26:12 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:26:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 10:26:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:26:12 [DEBUG   ] Finished updating board flags in 1.362 seconds
2021-04-01 10:26:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 10:26:19 [DEBUG   ] Got command BAM from MCS: ref #14404
2021-04-01 10:26:19 [INFO    ] Finished processing BAM request
2021-04-01 10:26:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14404   8 59305 37579029 A  ERROR'
2021-04-01 10:26:19 [DEBUG   ] Got command BAM from MCS: ref #14403
2021-04-01 10:26:19 [INFO    ] Finished processing BAM request
2021-04-01 10:26:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14403   8 59305 37579033 A  ERROR'
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:26:19 [DEBUG   ] spawn_process: at 2021-04-01 10:26:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:26:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:26:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:27:07 [DEBUG   ] Got command BAM from MCS: ref #14405
2021-04-01 10:27:07 [INFO    ] Finished processing BAM request
2021-04-01 10:27:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:27:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14405   8 59305 37627037 A  ERROR'
2021-04-01 10:27:07 [DEBUG   ] Got command BAM from MCS: ref #14406
2021-04-01 10:27:07 [INFO    ] Finished processing BAM request
2021-04-01 10:27:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:27:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14406   8 59305 37627045 A  ERROR'
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:27:07 [DEBUG   ] spawn_process: at 2021-04-01 10:27:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:27:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2021-04-01 10:27:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2021-04-01 10:27:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:27:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 10:27:12 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:27:12 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:27:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 10:27:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:27:12 [DEBUG   ] Finished updating board flags in 1.173 seconds
2021-04-01 10:27:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:27:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:27:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:27:55 [DEBUG   ] Got command BAM from MCS: ref #14408
2021-04-01 10:27:55 [INFO    ] Finished processing BAM request
2021-04-01 10:27:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:27:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14408   8 59305 37675033 A  ERROR'
2021-04-01 10:27:55 [DEBUG   ] Got command BAM from MCS: ref #14407
2021-04-01 10:27:55 [INFO    ] Finished processing BAM request
2021-04-01 10:27:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:27:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14407   8 59305 37675037 A  ERROR'
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:27:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:27:55 [DEBUG   ] spawn_process: at 2021-04-01 10:27:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:28:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:28:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:28:12 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:28:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 10:28:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 10:28:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:28:12 [DEBUG   ] Finished updating board flags in 1.011 seconds
2021-04-01 10:28:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:28:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:28:43 [DEBUG   ] Got command BAM from MCS: ref #14416
2021-04-01 10:28:43 [INFO    ] Finished processing BAM request
2021-04-01 10:28:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14416   8 59305 37723025 A  ERROR'
2021-04-01 10:28:43 [DEBUG   ] Got command BAM from MCS: ref #14415
2021-04-01 10:28:43 [INFO    ] Finished processing BAM request
2021-04-01 10:28:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:28:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14415   8 59305 37723029 A  ERROR'
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:28:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:28:43 [DEBUG   ] spawn_process: at 2021-04-01 10:28:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:28:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:29:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2021-04-01 10:29:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:29:12 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:29:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 10:29:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:29:12 [DEBUG   ] Finished updating board flags in 1.076 seconds
2021-04-01 10:29:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:29:20 [DEBUG   ] Got command RPT from MCS: ref #14417
2021-04-01 10:29:20 [DEBUG   ] summary = ERROR
2021-04-01 10:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14417  13 59305 37760521 A  ERRORERROR'
2021-04-01 10:29:20 [DEBUG   ] Got command RPT from MCS: ref #14418
2021-04-01 10:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14418  77 59305 37760521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:29:31 [DEBUG   ] Got command BAM from MCS: ref #14435
2021-04-01 10:29:31 [INFO    ] Finished processing BAM request
2021-04-01 10:29:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:29:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14435   8 59305 37771025 A  ERROR'
2021-04-01 10:29:31 [DEBUG   ] Got command BAM from MCS: ref #14434
2021-04-01 10:29:31 [INFO    ] Finished processing BAM request
2021-04-01 10:29:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:29:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14434   8 59305 37771029 A  ERROR'
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:29:31 [DEBUG   ] spawn_process: at 2021-04-01 10:29:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:29:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:29:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:29:56 [DEBUG   ] Got command RPT from MCS: ref #14438
2021-04-01 10:29:56 [DEBUG   ] summary = ERROR
2021-04-01 10:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14438  13 59305 37796925 A  ERRORERROR'
2021-04-01 10:29:57 [DEBUG   ] Got command RPT from MCS: ref #14439
2021-04-01 10:29:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14439  77 59305 37797129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:29:57 [DEBUG   ] Got command RPT from MCS: ref #14440
2021-04-01 10:29:57 [DEBUG   ] summary = ERROR
2021-04-01 10:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14440  13 59305 37797321 A  ERRORERROR'
2021-04-01 10:29:57 [DEBUG   ] Got command RPT from MCS: ref #14441
2021-04-01 10:29:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14441  77 59305 37797525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:29:57 [DEBUG   ] Got command RPT from MCS: ref #14443
2021-04-01 10:29:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14443  12 59305 37797729 A  ERRORB¥ff'
2021-04-01 10:30:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2021-04-01 10:30:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:30:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 10:30:13 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2021-04-01 10:30:13 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:30:13 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:30:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:30:13 [DEBUG   ] Finished updating board flags in 2.011 seconds
2021-04-01 10:30:19 [DEBUG   ] Got command BAM from MCS: ref #14448
2021-04-01 10:30:19 [INFO    ] Finished processing BAM request
2021-04-01 10:30:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14448   8 59305 37819033 A  ERROR'
2021-04-01 10:30:19 [DEBUG   ] Got command BAM from MCS: ref #14449
2021-04-01 10:30:19 [INFO    ] Finished processing BAM request
2021-04-01 10:30:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:30:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14449   8 59305 37819037 A  ERROR'
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:30:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:30:19 [DEBUG   ] spawn_process: at 2021-04-01 10:30:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:30:33 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2021-04-01 10:30:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 10:31:07 [DEBUG   ] Got command BAM from MCS: ref #14457
2021-04-01 10:31:07 [INFO    ] Finished processing BAM request
2021-04-01 10:31:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:31:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14457   8 59305 37867029 A  ERROR'
2021-04-01 10:31:07 [DEBUG   ] Got command BAM from MCS: ref #14456
2021-04-01 10:31:07 [INFO    ] Finished processing BAM request
2021-04-01 10:31:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:31:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14456   8 59305 37867033 A  ERROR'
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 10:31:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 10:31:07 [DEBUG   ] spawn_process: at 2021-04-01 10:31:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 10:31:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 10:31:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2021-04-01 10:31:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:31:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 10:31:12 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:31:12 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:31:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:31:12 [DEBUG   ] Finished updating board flags in 1.402 seconds
2021-04-01 10:31:13 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-04-01 10:31:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:31:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 10:31:55 [DEBUG   ] Got command BAM from MCS: ref #14459
2021-04-01 10:31:55 [INFO    ] Finished processing BAM request
2021-04-01 10:31:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14459   8 59305 37915029 A  ERROR'
2021-04-01 10:31:55 [DEBUG   ] Got command BAM from MCS: ref #14458
2021-04-01 10:31:55 [INFO    ] Finished processing BAM request
2021-04-01 10:31:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:31:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14458   8 59305 37915033 A  ERROR'
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:31:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:31:55 [DEBUG   ] spawn_process: at 2021-04-01 10:31:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:32:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2021-04-01 10:32:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 10:32:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:32:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:32:12 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:32:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 10:32:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 10:32:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:32:12 [DEBUG   ] Finished updating board flags in 1.396 seconds
2021-04-01 10:32:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:32:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:32:43 [DEBUG   ] Got command BAM from MCS: ref #14460
2021-04-01 10:32:43 [INFO    ] Finished processing BAM request
2021-04-01 10:32:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14460   8 59305 37963029 A  ERROR'
2021-04-01 10:32:43 [DEBUG   ] Got command BAM from MCS: ref #14461
2021-04-01 10:32:43 [INFO    ] Finished processing BAM request
2021-04-01 10:32:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:32:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14461   8 59305 37963033 A  ERROR'
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:32:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:32:43 [DEBUG   ] spawn_process: at 2021-04-01 10:32:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:32:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:33:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:33:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:33:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 10:33:12 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:33:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 10:33:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:33:12 [DEBUG   ] Finished updating board flags in 1.173 seconds
2021-04-01 10:33:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:33:31 [DEBUG   ] Got command BAM from MCS: ref #14463
2021-04-01 10:33:31 [INFO    ] Finished processing BAM request
2021-04-01 10:33:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14463   8 59305 38011029 A  ERROR'
2021-04-01 10:33:31 [DEBUG   ] Got command BAM from MCS: ref #14462
2021-04-01 10:33:31 [INFO    ] Finished processing BAM request
2021-04-01 10:33:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14462   8 59305 38011033 A  ERROR'
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 10:33:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 10:33:31 [DEBUG   ] spawn_process: at 2021-04-01 10:33:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 10:33:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:33:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:34:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 10:34:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:34:12 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:34:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 10:34:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:34:12 [DEBUG   ] Finished updating board flags in 1.022 seconds
2021-04-01 10:34:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:34:19 [DEBUG   ] Got command BAM from MCS: ref #14470
2021-04-01 10:34:19 [INFO    ] Finished processing BAM request
2021-04-01 10:34:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:34:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14470   8 59305 38059025 A  ERROR'
2021-04-01 10:34:19 [DEBUG   ] Got command BAM from MCS: ref #14471
2021-04-01 10:34:19 [INFO    ] Finished processing BAM request
2021-04-01 10:34:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:34:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14471   8 59305 38059029 A  ERROR'
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:34:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:34:19 [DEBUG   ] spawn_process: at 2021-04-01 10:34:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:34:20 [DEBUG   ] Got command RPT from MCS: ref #14472
2021-04-01 10:34:20 [DEBUG   ] summary = ERROR
2021-04-01 10:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14472  13 59305 38060517 A  ERRORERROR'
2021-04-01 10:34:20 [DEBUG   ] Got command RPT from MCS: ref #14473
2021-04-01 10:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14473  77 59305 38060517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:34:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:34:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:34:56 [DEBUG   ] Got command RPT from MCS: ref #14489
2021-04-01 10:34:56 [DEBUG   ] summary = ERROR
2021-04-01 10:34:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14489  13 59305 38096997 A  ERRORERROR'
2021-04-01 10:34:57 [DEBUG   ] Got command RPT from MCS: ref #14490
2021-04-01 10:34:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14490  77 59305 38097201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:34:57 [DEBUG   ] Got command RPT from MCS: ref #14491
2021-04-01 10:34:57 [DEBUG   ] summary = ERROR
2021-04-01 10:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14491  13 59305 38097393 A  ERRORERROR'
2021-04-01 10:34:57 [DEBUG   ] Got command RPT from MCS: ref #14492
2021-04-01 10:34:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14492  77 59305 38097597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:34:57 [DEBUG   ] Got command RPT from MCS: ref #14493
2021-04-01 10:34:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14493  12 59305 38097801 A  ERRORB¤ff'
2021-04-01 10:35:07 [DEBUG   ] Got command BAM from MCS: ref #14495
2021-04-01 10:35:07 [INFO    ] Finished processing BAM request
2021-04-01 10:35:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14495   8 59305 38107025 A  ERROR'
2021-04-01 10:35:07 [DEBUG   ] Got command BAM from MCS: ref #14494
2021-04-01 10:35:07 [INFO    ] Finished processing BAM request
2021-04-01 10:35:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:35:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14494   8 59305 38107029 A  ERROR'
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:35:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:35:07 [DEBUG   ] spawn_process: at 2021-04-01 10:35:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:35:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:35:12 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:35:12 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 10:35:12 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:35:12 [DEBUG   ] Finished updating board flags in 0.962 seconds
2021-04-01 10:35:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:35:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:35:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:35:55 [DEBUG   ] Got command BAM from MCS: ref #14497
2021-04-01 10:35:55 [INFO    ] Finished processing BAM request
2021-04-01 10:35:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:35:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14497   8 59305 38155025 A  ERROR'
2021-04-01 10:35:55 [DEBUG   ] Got command BAM from MCS: ref #14496
2021-04-01 10:35:55 [INFO    ] Finished processing BAM request
2021-04-01 10:35:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:35:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14496   8 59305 38155029 A  ERROR'
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:35:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:35:55 [DEBUG   ] spawn_process: at 2021-04-01 10:35:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:36:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:36:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 10:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 10:36:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:36:13 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 10:36:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 10:36:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:36:13 [DEBUG   ] Finished updating board flags in 1.387 seconds
2021-04-01 10:36:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 10:36:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:36:43 [DEBUG   ] Got command BAM from MCS: ref #14499
2021-04-01 10:36:43 [INFO    ] Finished processing BAM request
2021-04-01 10:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14499   8 59305 38203025 A  ERROR'
2021-04-01 10:36:43 [DEBUG   ] Got command BAM from MCS: ref #14498
2021-04-01 10:36:43 [INFO    ] Finished processing BAM request
2021-04-01 10:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14498   8 59305 38203029 A  ERROR'
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 10:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 10:36:43 [DEBUG   ] spawn_process: at 2021-04-01 10:36:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 10:36:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 10:37:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 10:37:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-04-01 10:37:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:37:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:37:13 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:37:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:37:13 [DEBUG   ] Finished updating board flags in 1.193 seconds
2021-04-01 10:37:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 10:37:31 [DEBUG   ] Got command BAM from MCS: ref #14506
2021-04-01 10:37:31 [INFO    ] Finished processing BAM request
2021-04-01 10:37:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14506   8 59305 38251029 A  ERROR'
2021-04-01 10:37:31 [DEBUG   ] Got command BAM from MCS: ref #14507
2021-04-01 10:37:31 [INFO    ] Finished processing BAM request
2021-04-01 10:37:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:37:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14507   8 59305 38251033 A  ERROR'
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:37:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:37:31 [DEBUG   ] spawn_process: at 2021-04-01 10:37:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:37:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 10:37:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 10:38:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:38:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:38:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:38:13 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:38:13 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:38:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 10:38:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:38:13 [DEBUG   ] Finished updating board flags in 0.997 seconds
2021-04-01 10:38:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 10:38:19 [DEBUG   ] Got command BAM from MCS: ref #14508
2021-04-01 10:38:19 [INFO    ] Finished processing BAM request
2021-04-01 10:38:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14508   8 59305 38299025 A  ERROR'
2021-04-01 10:38:19 [DEBUG   ] Got command BAM from MCS: ref #14509
2021-04-01 10:38:19 [INFO    ] Finished processing BAM request
2021-04-01 10:38:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14509   8 59305 38299029 A  ERROR'
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:38:19 [DEBUG   ] spawn_process: at 2021-04-01 10:38:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:38:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 10:38:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 10:39:07 [DEBUG   ] Got command BAM from MCS: ref #14511
2021-04-01 10:39:07 [INFO    ] Finished processing BAM request
2021-04-01 10:39:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:39:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14511   8 59305 38347057 A  ERROR'
2021-04-01 10:39:07 [DEBUG   ] Got command BAM from MCS: ref #14510
2021-04-01 10:39:07 [INFO    ] Finished processing BAM request
2021-04-01 10:39:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:39:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14510   8 59305 38347061 A  ERROR'
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 10:39:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 10:39:07 [DEBUG   ] spawn_process: at 2021-04-01 10:39:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 10:39:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:39:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:39:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 10:39:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:39:13 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:39:13 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:39:13 [DEBUG   ] Finished updating board flags in 1.281 seconds
2021-04-01 10:39:14 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-04-01 10:39:20 [DEBUG   ] Got command RPT from MCS: ref #14512
2021-04-01 10:39:20 [DEBUG   ] summary = ERROR
2021-04-01 10:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14512  13 59305 38360525 A  ERRORERROR'
2021-04-01 10:39:20 [DEBUG   ] Got command RPT from MCS: ref #14513
2021-04-01 10:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14513  77 59305 38360525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:39:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 10:39:55 [DEBUG   ] Got command BAM from MCS: ref #14530
2021-04-01 10:39:55 [INFO    ] Finished processing BAM request
2021-04-01 10:39:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14530   8 59305 38395029 A  ERROR'
2021-04-01 10:39:55 [DEBUG   ] Got command BAM from MCS: ref #14529
2021-04-01 10:39:55 [INFO    ] Finished processing BAM request
2021-04-01 10:39:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:39:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14529   8 59305 38395033 A  ERROR'
2021-04-01 10:39:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:39:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:39:55 [DEBUG   ] spawn_process: at 2021-04-01 10:39:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:39:57 [DEBUG   ] Got command RPT from MCS: ref #14534
2021-04-01 10:39:57 [DEBUG   ] summary = ERROR
2021-04-01 10:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14534  13 59305 38397073 A  ERRORERROR'
2021-04-01 10:39:57 [DEBUG   ] Got command RPT from MCS: ref #14536
2021-04-01 10:39:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14536  77 59305 38397265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:39:57 [DEBUG   ] Got command RPT from MCS: ref #14538
2021-04-01 10:39:57 [DEBUG   ] summary = ERROR
2021-04-01 10:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14538  13 59305 38397469 A  ERRORERROR'
2021-04-01 10:39:57 [DEBUG   ] Got command RPT from MCS: ref #14540
2021-04-01 10:39:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14540  77 59305 38397673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:39:57 [DEBUG   ] Got command RPT from MCS: ref #14543
2021-04-01 10:39:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14543  12 59305 38397865 A  ERRORB¤ff'
2021-04-01 10:40:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:40:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 10:40:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 10:40:15 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:40:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:40:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 10:40:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:40:15 [DEBUG   ] Finished updating board flags in 2.871 seconds
2021-04-01 10:40:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 10:40:43 [DEBUG   ] Got command BAM from MCS: ref #14549
2021-04-01 10:40:43 [INFO    ] Finished processing BAM request
2021-04-01 10:40:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:40:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14549   8 59305 38443025 A  ERROR'
2021-04-01 10:40:43 [DEBUG   ] Got command BAM from MCS: ref #14550
2021-04-01 10:40:43 [INFO    ] Finished processing BAM request
2021-04-01 10:40:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:40:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14550   8 59305 38443029 A  ERROR'
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 10:40:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 10:40:43 [DEBUG   ] spawn_process: at 2021-04-01 10:40:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 10:40:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:41:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:41:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:41:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 10:41:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 10:41:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:41:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:41:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:41:14 [DEBUG   ] Finished updating board flags in 1.702 seconds
2021-04-01 10:41:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 10:41:31 [DEBUG   ] Got command BAM from MCS: ref #14552
2021-04-01 10:41:31 [INFO    ] Finished processing BAM request
2021-04-01 10:41:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14552   8 59305 38491025 A  ERROR'
2021-04-01 10:41:31 [DEBUG   ] Got command BAM from MCS: ref #14551
2021-04-01 10:41:31 [INFO    ] Finished processing BAM request
2021-04-01 10:41:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:41:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14551   8 59305 38491029 A  ERROR'
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:41:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:41:31 [DEBUG   ] spawn_process: at 2021-04-01 10:41:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:41:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:41:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:42:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:42:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:42:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:42:14 [DEBUG   ] Finished updating board flags in 1.567 seconds
2021-04-01 10:42:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:42:19 [DEBUG   ] Got command BAM from MCS: ref #14554
2021-04-01 10:42:19 [INFO    ] Finished processing BAM request
2021-04-01 10:42:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14554   8 59305 38539025 A  ERROR'
2021-04-01 10:42:19 [DEBUG   ] Got command BAM from MCS: ref #14553
2021-04-01 10:42:19 [INFO    ] Finished processing BAM request
2021-04-01 10:42:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14553   8 59305 38539029 A  ERROR'
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:42:19 [DEBUG   ] spawn_process: at 2021-04-01 10:42:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:42:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:42:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:43:07 [DEBUG   ] Got command BAM from MCS: ref #14561
2021-04-01 10:43:07 [INFO    ] Finished processing BAM request
2021-04-01 10:43:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14561   8 59305 38587033 A  ERROR'
2021-04-01 10:43:07 [DEBUG   ] Got command BAM from MCS: ref #14562
2021-04-01 10:43:07 [INFO    ] Finished processing BAM request
2021-04-01 10:43:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:43:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14562   8 59305 38587037 A  ERROR'
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 10:43:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 10:43:07 [DEBUG   ] spawn_process: at 2021-04-01 10:43:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 10:43:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:43:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:43:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:43:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:43:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:43:14 [DEBUG   ] Finished updating board flags in 1.370 seconds
2021-04-01 10:43:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:43:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:43:55 [DEBUG   ] Got command BAM from MCS: ref #14564
2021-04-01 10:43:55 [INFO    ] Finished processing BAM request
2021-04-01 10:43:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14564   8 59305 38635029 A  ERROR'
2021-04-01 10:43:55 [DEBUG   ] Got command BAM from MCS: ref #14563
2021-04-01 10:43:55 [INFO    ] Finished processing BAM request
2021-04-01 10:43:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:43:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14563   8 59305 38635033 A  ERROR'
2021-04-01 10:43:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 10:43:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 10:43:55 [DEBUG   ] spawn_process: at 2021-04-01 10:43:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 10:44:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:44:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:44:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 10:44:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:44:14 [DEBUG   ] Finished updating board flags in 1.265 seconds
2021-04-01 10:44:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:44:20 [DEBUG   ] Got command RPT from MCS: ref #14565
2021-04-01 10:44:20 [DEBUG   ] summary = ERROR
2021-04-01 10:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14565  13 59305 38660529 A  ERRORERROR'
2021-04-01 10:44:20 [DEBUG   ] Got command RPT from MCS: ref #14566
2021-04-01 10:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14566  77 59305 38660529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:44:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:44:43 [DEBUG   ] Got command BAM from MCS: ref #14582
2021-04-01 10:44:43 [INFO    ] Finished processing BAM request
2021-04-01 10:44:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:44:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14582   8 59305 38683033 A  ERROR'
2021-04-01 10:44:43 [DEBUG   ] Got command BAM from MCS: ref #14583
2021-04-01 10:44:43 [INFO    ] Finished processing BAM request
2021-04-01 10:44:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:44:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14583   8 59305 38683037 A  ERROR'
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 10:44:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 10:44:43 [DEBUG   ] spawn_process: at 2021-04-01 10:44:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 10:44:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 10:44:57 [DEBUG   ] Got command RPT from MCS: ref #14584
2021-04-01 10:44:57 [DEBUG   ] summary = ERROR
2021-04-01 10:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14584  13 59305 38697141 A  ERRORERROR'
2021-04-01 10:44:57 [DEBUG   ] Got command RPT from MCS: ref #14585
2021-04-01 10:44:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14585  77 59305 38697345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:44:57 [DEBUG   ] Got command RPT from MCS: ref #14586
2021-04-01 10:44:57 [DEBUG   ] summary = ERROR
2021-04-01 10:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14586  13 59305 38697549 A  ERRORERROR'
2021-04-01 10:44:57 [DEBUG   ] Got command RPT from MCS: ref #14587
2021-04-01 10:44:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14587  77 59305 38697741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:44:57 [DEBUG   ] Got command RPT from MCS: ref #14588
2021-04-01 10:44:57 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14588  12 59305 38697945 A  ERRORB£ff'
2021-04-01 10:45:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 10:45:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:45:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 10:45:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:45:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:45:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:45:14 [DEBUG   ] Finished updating board flags in 1.181 seconds
2021-04-01 10:45:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:45:31 [DEBUG   ] Got command BAM from MCS: ref #14589
2021-04-01 10:45:31 [INFO    ] Finished processing BAM request
2021-04-01 10:45:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14589   8 59305 38731025 A  ERROR'
2021-04-01 10:45:31 [DEBUG   ] Got command BAM from MCS: ref #14590
2021-04-01 10:45:31 [INFO    ] Finished processing BAM request
2021-04-01 10:45:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:45:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14590   8 59305 38731029 A  ERROR'
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:45:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:45:31 [DEBUG   ] spawn_process: at 2021-04-01 10:45:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:45:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:45:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:46:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:46:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:46:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:46:15 [DEBUG   ] Finished updating ant stats in 0.626 seconds
2021-04-01 10:46:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 10:46:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:46:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:46:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:46:15 [DEBUG   ] Finished updating board flags in 2.033 seconds
2021-04-01 10:46:19 [DEBUG   ] Got command BAM from MCS: ref #14597
2021-04-01 10:46:19 [INFO    ] Finished processing BAM request
2021-04-01 10:46:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14597   8 59305 38779025 A  ERROR'
2021-04-01 10:46:19 [DEBUG   ] Got command BAM from MCS: ref #14598
2021-04-01 10:46:19 [INFO    ] Finished processing BAM request
2021-04-01 10:46:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:46:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14598   8 59305 38779029 A  ERROR'
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:46:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:46:19 [DEBUG   ] spawn_process: at 2021-04-01 10:46:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:46:35 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2021-04-01 10:46:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 10:47:07 [DEBUG   ] Got command BAM from MCS: ref #14600
2021-04-01 10:47:07 [INFO    ] Finished processing BAM request
2021-04-01 10:47:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:47:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14600   8 59305 38827029 A  ERROR'
2021-04-01 10:47:07 [DEBUG   ] Got command BAM from MCS: ref #14599
2021-04-01 10:47:07 [INFO    ] Finished processing BAM request
2021-04-01 10:47:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:47:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14599   8 59305 38827033 A  ERROR'
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:47:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:47:07 [DEBUG   ] spawn_process: at 2021-04-01 10:47:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:47:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:47:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:47:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:47:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:47:14 [DEBUG   ] Finished updating board flags in 1.414 seconds
2021-04-01 10:47:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 10:47:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 10:47:55 [DEBUG   ] Got command BAM from MCS: ref #14601
2021-04-01 10:47:55 [INFO    ] Finished processing BAM request
2021-04-01 10:47:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:47:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14601   8 59305 38875029 A  ERROR'
2021-04-01 10:47:55 [DEBUG   ] Got command BAM from MCS: ref #14602
2021-04-01 10:47:55 [INFO    ] Finished processing BAM request
2021-04-01 10:47:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:47:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14602   8 59305 38875033 A  ERROR'
2021-04-01 10:47:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:47:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:47:55 [DEBUG   ] spawn_process: at 2021-04-01 10:47:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:48:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 10:48:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 10:48:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:48:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2021-04-01 10:48:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 10:48:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:48:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:48:15 [DEBUG   ] Finished updating board flags in 1.736 seconds
2021-04-01 10:48:15 [DEBUG   ] Finished updating ant stats in 0.396 seconds
2021-04-01 10:48:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 10:48:43 [DEBUG   ] Got command BAM from MCS: ref #14603
2021-04-01 10:48:43 [INFO    ] Finished processing BAM request
2021-04-01 10:48:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14603   8 59305 38923033 A  ERROR'
2021-04-01 10:48:43 [DEBUG   ] Got command BAM from MCS: ref #14604
2021-04-01 10:48:43 [INFO    ] Finished processing BAM request
2021-04-01 10:48:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:48:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14604   8 59305 38923037 A  ERROR'
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:48:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:48:43 [DEBUG   ] spawn_process: at 2021-04-01 10:48:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:48:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 10:49:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-04-01 10:49:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:49:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 10:49:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:49:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 10:49:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:49:15 [DEBUG   ] Finished updating board flags in 1.872 seconds
2021-04-01 10:49:16 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2021-04-01 10:49:20 [DEBUG   ] Got command RPT from MCS: ref #14611
2021-04-01 10:49:20 [DEBUG   ] summary = ERROR
2021-04-01 10:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14611  13 59305 38960521 A  ERRORERROR'
2021-04-01 10:49:20 [DEBUG   ] Got command RPT from MCS: ref #14612
2021-04-01 10:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14612  77 59305 38960521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:49:31 [DEBUG   ] Got command BAM from MCS: ref #14628
2021-04-01 10:49:31 [INFO    ] Finished processing BAM request
2021-04-01 10:49:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14628   8 59305 38971033 A  ERROR'
2021-04-01 10:49:31 [DEBUG   ] Got command BAM from MCS: ref #14629
2021-04-01 10:49:31 [INFO    ] Finished processing BAM request
2021-04-01 10:49:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:49:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14629   8 59305 38971037 A  ERROR'
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 10:49:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 10:49:31 [DEBUG   ] spawn_process: at 2021-04-01 10:49:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 10:49:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:49:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:49:57 [DEBUG   ] Got command RPT from MCS: ref #14632
2021-04-01 10:49:57 [DEBUG   ] summary = ERROR
2021-04-01 10:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14632  13 59305 38997209 A  ERRORERROR'
2021-04-01 10:49:57 [DEBUG   ] Got command RPT from MCS: ref #14633
2021-04-01 10:49:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14633  77 59305 38997413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:49:57 [DEBUG   ] Got command RPT from MCS: ref #14634
2021-04-01 10:49:57 [DEBUG   ] summary = ERROR
2021-04-01 10:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14634  13 59305 38997617 A  ERRORERROR'
2021-04-01 10:49:57 [DEBUG   ] Got command RPT from MCS: ref #14635
2021-04-01 10:49:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:49:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14635  77 59305 38997809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:49:58 [DEBUG   ] Got command RPT from MCS: ref #14637
2021-04-01 10:49:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14637  12 59305 38998013 A  ERRORB¤ff'
2021-04-01 10:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2021-04-01 10:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 10:50:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 10:50:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 10:50:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:50:14 [DEBUG   ] Finished updating board flags in 1.178 seconds
2021-04-01 10:50:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:50:19 [DEBUG   ] Got command BAM from MCS: ref #14643
2021-04-01 10:50:19 [INFO    ] Finished processing BAM request
2021-04-01 10:50:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14643   8 59305 39019029 A  ERROR'
2021-04-01 10:50:19 [DEBUG   ] Got command BAM from MCS: ref #14642
2021-04-01 10:50:19 [INFO    ] Finished processing BAM request
2021-04-01 10:50:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:50:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14642   8 59305 39019033 A  ERROR'
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:50:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:50:19 [DEBUG   ] spawn_process: at 2021-04-01 10:50:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:50:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:50:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:51:07 [DEBUG   ] Got command BAM from MCS: ref #14645
2021-04-01 10:51:07 [INFO    ] Finished processing BAM request
2021-04-01 10:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14645   8 59305 39067029 A  ERROR'
2021-04-01 10:51:07 [DEBUG   ] Got command BAM from MCS: ref #14644
2021-04-01 10:51:07 [INFO    ] Finished processing BAM request
2021-04-01 10:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14644   8 59305 39067033 A  ERROR'
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:51:07 [DEBUG   ] spawn_process: at 2021-04-01 10:51:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:51:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:51:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:51:14 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:51:14 [DEBUG   ] Finished updating board flags in 0.994 seconds
2021-04-01 10:51:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:51:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:51:55 [DEBUG   ] Got command BAM from MCS: ref #14647
2021-04-01 10:51:55 [INFO    ] Finished processing BAM request
2021-04-01 10:51:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14647   8 59305 39115025 A  ERROR'
2021-04-01 10:51:55 [DEBUG   ] Got command BAM from MCS: ref #14646
2021-04-01 10:51:55 [INFO    ] Finished processing BAM request
2021-04-01 10:51:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:51:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14646   8 59305 39115029 A  ERROR'
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:51:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:51:55 [DEBUG   ] spawn_process: at 2021-04-01 10:51:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:51:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:52:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:52:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 10:52:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:52:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:52:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:52:15 [DEBUG   ] Finished updating board flags in 1.356 seconds
2021-04-01 10:52:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:52:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 10:52:43 [DEBUG   ] Got command BAM from MCS: ref #14654
2021-04-01 10:52:43 [INFO    ] Finished processing BAM request
2021-04-01 10:52:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14654   8 59305 39163029 A  ERROR'
2021-04-01 10:52:43 [DEBUG   ] Got command BAM from MCS: ref #14655
2021-04-01 10:52:43 [INFO    ] Finished processing BAM request
2021-04-01 10:52:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14655   8 59305 39163033 A  ERROR'
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:52:43 [DEBUG   ] spawn_process: at 2021-04-01 10:52:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:52:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 10:53:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:53:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:53:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 10:53:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:53:15 [DEBUG   ] Finished updating board flags in 1.226 seconds
2021-04-01 10:53:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2021-04-01 10:53:31 [DEBUG   ] Got command BAM from MCS: ref #14657
2021-04-01 10:53:31 [INFO    ] Finished processing BAM request
2021-04-01 10:53:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14657   8 59305 39211029 A  ERROR'
2021-04-01 10:53:31 [DEBUG   ] Got command BAM from MCS: ref #14656
2021-04-01 10:53:31 [INFO    ] Finished processing BAM request
2021-04-01 10:53:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14656   8 59305 39211033 A  ERROR'
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:53:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:53:31 [DEBUG   ] spawn_process: at 2021-04-01 10:53:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:53:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:53:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:54:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:54:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:54:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:54:15 [DEBUG   ] Finished updating board flags in 1.170 seconds
2021-04-01 10:54:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:54:19 [DEBUG   ] Got command BAM from MCS: ref #14659
2021-04-01 10:54:19 [INFO    ] Finished processing BAM request
2021-04-01 10:54:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:54:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14659   8 59305 39259025 A  ERROR'
2021-04-01 10:54:19 [DEBUG   ] Got command BAM from MCS: ref #14658
2021-04-01 10:54:19 [INFO    ] Finished processing BAM request
2021-04-01 10:54:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:54:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14658   8 59305 39259029 A  ERROR'
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 10:54:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 10:54:19 [DEBUG   ] spawn_process: at 2021-04-01 10:54:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 10:54:20 [DEBUG   ] Got command RPT from MCS: ref #14660
2021-04-01 10:54:20 [DEBUG   ] summary = ERROR
2021-04-01 10:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14660  13 59305 39260529 A  ERRORERROR'
2021-04-01 10:54:20 [DEBUG   ] Got command RPT from MCS: ref #14661
2021-04-01 10:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14661  77 59305 39260529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:54:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:54:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:54:57 [DEBUG   ] Got command RPT from MCS: ref #14678
2021-04-01 10:54:57 [DEBUG   ] summary = ERROR
2021-04-01 10:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14678  13 59305 39297285 A  ERRORERROR'
2021-04-01 10:54:57 [DEBUG   ] Got command RPT from MCS: ref #14680
2021-04-01 10:54:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14680  77 59305 39297489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:54:57 [DEBUG   ] Got command RPT from MCS: ref #14682
2021-04-01 10:54:57 [DEBUG   ] summary = ERROR
2021-04-01 10:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14682  13 59305 39297681 A  ERRORERROR'
2021-04-01 10:54:57 [DEBUG   ] Got command RPT from MCS: ref #14684
2021-04-01 10:54:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:54:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14684  77 59305 39297885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:54:58 [DEBUG   ] Got command RPT from MCS: ref #14686
2021-04-01 10:54:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14686  12 59305 39298089 A  ERRORB£ff'
2021-04-01 10:55:07 [DEBUG   ] Got command BAM from MCS: ref #14688
2021-04-01 10:55:07 [INFO    ] Finished processing BAM request
2021-04-01 10:55:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14688   8 59305 39307053 A  ERROR'
2021-04-01 10:55:07 [DEBUG   ] Got command BAM from MCS: ref #14689
2021-04-01 10:55:07 [INFO    ] Finished processing BAM request
2021-04-01 10:55:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:55:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14689   8 59305 39307057 A  ERROR'
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:55:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:55:07 [DEBUG   ] spawn_process: at 2021-04-01 10:55:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:55:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 10:55:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:55:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:55:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:55:15 [DEBUG   ] Finished updating board flags in 1.000 seconds
2021-04-01 10:55:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:55:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 10:55:55 [DEBUG   ] Got command BAM from MCS: ref #14690
2021-04-01 10:55:55 [INFO    ] Finished processing BAM request
2021-04-01 10:55:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:55:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14690   8 59305 39355029 A  ERROR'
2021-04-01 10:55:55 [DEBUG   ] Got command BAM from MCS: ref #14691
2021-04-01 10:55:55 [INFO    ] Finished processing BAM request
2021-04-01 10:55:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:55:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14691   8 59305 39355033 A  ERROR'
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:55:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:55:55 [DEBUG   ] spawn_process: at 2021-04-01 10:55:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:55:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:56:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 10:56:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:56:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:56:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:56:15 [DEBUG   ] Finished updating board flags in 1.059 seconds
2021-04-01 10:56:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:56:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:56:43 [DEBUG   ] Got command BAM from MCS: ref #14692
2021-04-01 10:56:43 [INFO    ] Finished processing BAM request
2021-04-01 10:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14692   8 59305 39403033 A  ERROR'
2021-04-01 10:56:43 [DEBUG   ] Got command BAM from MCS: ref #14693
2021-04-01 10:56:43 [INFO    ] Finished processing BAM request
2021-04-01 10:56:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:56:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14693   8 59305 39403037 A  ERROR'
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:56:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:56:43 [DEBUG   ] spawn_process: at 2021-04-01 10:56:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:56:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 10:57:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2021-04-01 10:57:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:57:16 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2021-04-01 10:57:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:57:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:57:16 [DEBUG   ] Finished updating board flags in 2.057 seconds
2021-04-01 10:57:31 [DEBUG   ] Got command BAM from MCS: ref #14695
2021-04-01 10:57:31 [INFO    ] Finished processing BAM request
2021-04-01 10:57:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14695   8 59305 39451025 A  ERROR'
2021-04-01 10:57:31 [DEBUG   ] Got command BAM from MCS: ref #14694
2021-04-01 10:57:31 [INFO    ] Finished processing BAM request
2021-04-01 10:57:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:57:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14694   8 59305 39451029 A  ERROR'
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 10:57:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 10:57:31 [DEBUG   ] spawn_process: at 2021-04-01 10:57:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 10:57:36 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 10:57:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 10:58:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 10:58:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:58:16 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2021-04-01 10:58:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 10:58:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:58:16 [DEBUG   ] Finished updating board flags in 1.944 seconds
2021-04-01 10:58:19 [DEBUG   ] Got command BAM from MCS: ref #14703
2021-04-01 10:58:19 [INFO    ] Finished processing BAM request
2021-04-01 10:58:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14703   8 59305 39499033 A  ERROR'
2021-04-01 10:58:19 [DEBUG   ] Got command BAM from MCS: ref #14702
2021-04-01 10:58:19 [INFO    ] Finished processing BAM request
2021-04-01 10:58:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14702   8 59305 39499037 A  ERROR'
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:58:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:58:19 [DEBUG   ] spawn_process: at 2021-04-01 10:58:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:58:36 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2021-04-01 10:58:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 10:59:07 [DEBUG   ] Got command BAM from MCS: ref #14704
2021-04-01 10:59:07 [INFO    ] Finished processing BAM request
2021-04-01 10:59:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:59:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14704   8 59305 39547033 A  ERROR'
2021-04-01 10:59:07 [DEBUG   ] Got command BAM from MCS: ref #14705
2021-04-01 10:59:07 [INFO    ] Finished processing BAM request
2021-04-01 10:59:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:59:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14705   8 59305 39547037 A  ERROR'
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 10:59:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 10:59:07 [DEBUG   ] spawn_process: at 2021-04-01 10:59:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 10:59:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 10:59:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 10:59:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 10:59:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 10:59:15 [DEBUG   ] Finished updating board flags in 1.194 seconds
2021-04-01 10:59:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:59:20 [DEBUG   ] Got command RPT from MCS: ref #14706
2021-04-01 10:59:20 [DEBUG   ] summary = ERROR
2021-04-01 10:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14706  13 59305 39560533 A  ERRORERROR'
2021-04-01 10:59:20 [DEBUG   ] Got command RPT from MCS: ref #14707
2021-04-01 10:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14707  77 59305 39560533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:59:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:59:55 [DEBUG   ] Got command BAM from MCS: ref #14724
2021-04-01 10:59:55 [INFO    ] Finished processing BAM request
2021-04-01 10:59:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14724   8 59305 39595025 A  ERROR'
2021-04-01 10:59:55 [DEBUG   ] Got command BAM from MCS: ref #14723
2021-04-01 10:59:55 [INFO    ] Finished processing BAM request
2021-04-01 10:59:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 10:59:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14723   8 59305 39595029 A  ERROR'
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 10:59:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 10:59:55 [DEBUG   ] spawn_process: at 2021-04-01 10:59:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 10:59:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 10:59:57 [DEBUG   ] Got command RPT from MCS: ref #14727
2021-04-01 10:59:57 [DEBUG   ] summary = ERROR
2021-04-01 10:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14727  13 59305 39597357 A  ERRORERROR'
2021-04-01 10:59:57 [DEBUG   ] Got command RPT from MCS: ref #14728
2021-04-01 10:59:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14728  77 59305 39597561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:59:57 [DEBUG   ] Got command RPT from MCS: ref #14729
2021-04-01 10:59:57 [DEBUG   ] summary = ERROR
2021-04-01 10:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14729  13 59305 39597765 A  ERRORERROR'
2021-04-01 10:59:57 [DEBUG   ] Got command RPT from MCS: ref #14730
2021-04-01 10:59:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 10:59:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14730  77 59305 39597957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 10:59:58 [DEBUG   ] Got command RPT from MCS: ref #14732
2021-04-01 10:59:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 10:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14732  12 59305 39598161 A  ERRORB¢ff'
2021-04-01 11:00:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:00:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 11:00:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 11:00:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 11:00:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:00:15 [DEBUG   ] Finished updating board flags in 1.015 seconds
2021-04-01 11:00:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 11:00:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 11:00:43 [DEBUG   ] Got command BAM from MCS: ref #14737
2021-04-01 11:00:43 [INFO    ] Finished processing BAM request
2021-04-01 11:00:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:00:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14737   8 59305 39643029 A  ERROR'
2021-04-01 11:00:43 [DEBUG   ] Got command BAM from MCS: ref #14738
2021-04-01 11:00:43 [INFO    ] Finished processing BAM request
2021-04-01 11:00:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:00:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14738   8 59305 39643033 A  ERROR'
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 11:00:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 11:00:43 [DEBUG   ] spawn_process: at 2021-04-01 11:00:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 11:00:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:01:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 11:01:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-04-01 11:01:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:01:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 11:01:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 11:01:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:01:15 [DEBUG   ] Finished updating board flags in 1.045 seconds
2021-04-01 11:01:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:01:31 [DEBUG   ] Got command BAM from MCS: ref #14745
2021-04-01 11:01:31 [INFO    ] Finished processing BAM request
2021-04-01 11:01:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14745   8 59305 39691033 A  ERROR'
2021-04-01 11:01:31 [DEBUG   ] Got command BAM from MCS: ref #14746
2021-04-01 11:01:31 [INFO    ] Finished processing BAM request
2021-04-01 11:01:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:01:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14746   8 59305 39691037 A  ERROR'
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 11:01:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 11:01:31 [DEBUG   ] spawn_process: at 2021-04-01 11:01:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 11:01:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:01:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:02:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:02:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 11:02:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 11:02:15 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:02:15 [DEBUG   ] Finished updating board flags in 0.977 seconds
2021-04-01 11:02:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:02:19 [DEBUG   ] Got command BAM from MCS: ref #14748
2021-04-01 11:02:19 [INFO    ] Finished processing BAM request
2021-04-01 11:02:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14748   8 59305 39739029 A  ERROR'
2021-04-01 11:02:19 [DEBUG   ] Got command BAM from MCS: ref #14747
2021-04-01 11:02:19 [INFO    ] Finished processing BAM request
2021-04-01 11:02:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14747   8 59305 39739033 A  ERROR'
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 11:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 11:02:19 [DEBUG   ] spawn_process: at 2021-04-01 11:02:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 11:02:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:02:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:03:07 [DEBUG   ] Got command BAM from MCS: ref #14749
2021-04-01 11:03:07 [INFO    ] Finished processing BAM request
2021-04-01 11:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14749   8 59305 39787033 A  ERROR'
2021-04-01 11:03:07 [DEBUG   ] Got command BAM from MCS: ref #14750
2021-04-01 11:03:07 [INFO    ] Finished processing BAM request
2021-04-01 11:03:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:03:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14750   8 59305 39787037 A  ERROR'
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 11:03:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 11:03:07 [DEBUG   ] spawn_process: at 2021-04-01 11:03:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 11:03:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:03:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 11:03:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 11:03:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 11:03:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:03:16 [DEBUG   ] Finished updating board flags in 1.334 seconds
2021-04-01 11:03:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:03:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:03:55 [DEBUG   ] Got command BAM from MCS: ref #14752
2021-04-01 11:03:55 [INFO    ] Finished processing BAM request
2021-04-01 11:03:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14752   8 59305 39835029 A  ERROR'
2021-04-01 11:03:55 [DEBUG   ] Got command BAM from MCS: ref #14751
2021-04-01 11:03:55 [INFO    ] Finished processing BAM request
2021-04-01 11:03:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:03:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14751   8 59305 39835033 A  ERROR'
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 11:03:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 11:03:55 [DEBUG   ] spawn_process: at 2021-04-01 11:03:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 11:03:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:04:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:04:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 11:04:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 11:04:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:04:16 [DEBUG   ] Finished updating board flags in 1.227 seconds
2021-04-01 11:04:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:04:20 [DEBUG   ] Got command RPT from MCS: ref #14759
2021-04-01 11:04:20 [DEBUG   ] summary = ERROR
2021-04-01 11:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14759  13 59305 39860525 A  ERRORERROR'
2021-04-01 11:04:20 [DEBUG   ] Got command RPT from MCS: ref #14760
2021-04-01 11:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14760  77 59305 39860525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:04:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:04:43 [DEBUG   ] Got command BAM from MCS: ref #14776
2021-04-01 11:04:43 [INFO    ] Finished processing BAM request
2021-04-01 11:04:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14776   8 59305 39883029 A  ERROR'
2021-04-01 11:04:43 [DEBUG   ] Got command BAM from MCS: ref #14777
2021-04-01 11:04:43 [INFO    ] Finished processing BAM request
2021-04-01 11:04:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:04:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14777   8 59305 39883033 A  ERROR'
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 11:04:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 11:04:43 [DEBUG   ] spawn_process: at 2021-04-01 11:04:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 11:04:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:04:57 [DEBUG   ] Got command RPT from MCS: ref #14778
2021-04-01 11:04:57 [DEBUG   ] summary = ERROR
2021-04-01 11:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14778  13 59305 39897433 A  ERRORERROR'
2021-04-01 11:04:57 [DEBUG   ] Got command RPT from MCS: ref #14779
2021-04-01 11:04:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14779  77 59305 39897637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:04:57 [DEBUG   ] Got command RPT from MCS: ref #14780
2021-04-01 11:04:57 [DEBUG   ] summary = ERROR
2021-04-01 11:04:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14780  13 59305 39897851 A  ERRORERROR'
2021-04-01 11:04:58 [DEBUG   ] Got command RPT from MCS: ref #14781
2021-04-01 11:04:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14781  77 59305 39898029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:04:58 [DEBUG   ] Got command RPT from MCS: ref #14782
2021-04-01 11:04:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14782  12 59305 39898233 A  ERRORB¤ff'
2021-04-01 11:05:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 11:05:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:05:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 11:05:17 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 11:05:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 11:05:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:05:17 [DEBUG   ] Finished updating board flags in 2.222 seconds
2021-04-01 11:05:18 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2021-04-01 11:05:31 [DEBUG   ] Got command BAM from MCS: ref #14783
2021-04-01 11:05:31 [INFO    ] Finished processing BAM request
2021-04-01 11:05:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14783   8 59305 39931025 A  ERROR'
2021-04-01 11:05:31 [DEBUG   ] Got command BAM from MCS: ref #14784
2021-04-01 11:05:31 [INFO    ] Finished processing BAM request
2021-04-01 11:05:31 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:05:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14784   8 59305 39931029 A  ERROR'
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 11:05:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 11:05:31 [DEBUG   ] spawn_process: at 2021-04-01 11:05:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 11:05:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:05:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:06:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 11:06:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 11:06:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:06:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2021-04-01 11:06:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 11:06:16 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 11:06:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:06:16 [DEBUG   ] Finished updating board flags in 1.158 seconds
2021-04-01 11:06:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:06:19 [DEBUG   ] Got command BAM from MCS: ref #14785
2021-04-01 11:06:19 [INFO    ] Finished processing BAM request
2021-04-01 11:06:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14785   8 59305 39979029 A  ERROR'
2021-04-01 11:06:19 [DEBUG   ] Got command BAM from MCS: ref #14786
2021-04-01 11:06:19 [INFO    ] Finished processing BAM request
2021-04-01 11:06:19 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14786   8 59305 39979033 A  ERROR'
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 11:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 11:06:19 [DEBUG   ] spawn_process: at 2021-04-01 11:06:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 11:06:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:06:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:07:07 [DEBUG   ] Got command BAM from MCS: ref #14794
2021-04-01 11:07:07 [INFO    ] Finished processing BAM request
2021-04-01 11:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14794   8 59305 40027033 A  ERROR'
2021-04-01 11:07:07 [DEBUG   ] Got command BAM from MCS: ref #14793
2021-04-01 11:07:07 [INFO    ] Finished processing BAM request
2021-04-01 11:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14793   8 59305 40027037 A  ERROR'
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 11:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 11:07:07 [DEBUG   ] spawn_process: at 2021-04-01 11:07:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 11:07:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:07:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 11:07:16 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 11:07:16 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa7, chip 2
2021-04-01 11:07:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 11:07:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:07:16 [DEBUG   ] Finished updating board flags in 0.998 seconds
2021-04-01 11:07:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:07:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:07:55 [DEBUG   ] Got command BAM from MCS: ref #14796
2021-04-01 11:07:55 [INFO    ] Finished processing BAM request
2021-04-01 11:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14796   8 59305 40075033 A  ERROR'
2021-04-01 11:07:55 [DEBUG   ] Got command BAM from MCS: ref #14795
2021-04-01 11:07:55 [INFO    ] Finished processing BAM request
2021-04-01 11:07:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:07:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    14795   8 59305 40075037 A  ERROR'
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 11:07:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 11:07:55 [DEBUG   ] spawn_process: at 2021-04-01 11:07:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 11:07:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:08:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 11:08:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:08:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2021-04-01 11:08:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 11:08:17 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2021-04-01 11:08:17 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa21, chip 2
2021-04-01 11:08:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa7, chip 2
2021-04-01 11:08:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 11:08:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:08:17 [DEBUG   ] Finished updating board flags in 1.866 seconds
2021-04-01 11:08:37 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2021-04-01 11:08:45 [DEBUG   ] Got command STP from MCS: ref #14797
2021-04-01 11:08:45 [INFO    ] Finished processing BAM request
2021-04-01 11:08:45 [INFO    ] Shutdown the adder chain on beam #3
2021-04-01 11:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    14797   8 59305 40125033 A  ERROR'
2021-04-01 11:08:45 [DEBUG   ] Got command STP from MCS: ref #14798
2021-04-01 11:08:45 [INFO    ] Finished processing BAM request
2021-04-01 11:08:45 [INFO    ] Shutdown the adder chain on beam #4
2021-04-01 11:08:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP    14798   8 59305 40125037 A  ERROR'
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 11:08:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 11:08:45 [DEBUG   ] spawn_process: at 2021-04-01 11:08:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 11:08:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:09:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:09:17 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2021-04-01 11:09:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 11:09:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2021-04-01 11:09:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:09:17 [DEBUG   ] Finished updating board flags in 1.853 seconds
2021-04-01 11:09:20 [DEBUG   ] Got command RPT from MCS: ref #14799
2021-04-01 11:09:20 [DEBUG   ] summary = ERROR
2021-04-01 11:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14799  13 59305 40160533 A  ERRORERROR'
2021-04-01 11:09:20 [DEBUG   ] Got command RPT from MCS: ref #14800
2021-04-01 11:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14800  77 59305 40160533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:09:37 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2021-04-01 11:09:57 [DEBUG   ] Got command RPT from MCS: ref #14819
2021-04-01 11:09:57 [DEBUG   ] summary = ERROR
2021-04-01 11:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14819  13 59305 40197505 A  ERRORERROR'
2021-04-01 11:09:57 [DEBUG   ] Got command RPT from MCS: ref #14821
2021-04-01 11:09:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14821  77 59305 40197709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:09:57 [DEBUG   ] Got command RPT from MCS: ref #14823
2021-04-01 11:09:57 [DEBUG   ] summary = ERROR
2021-04-01 11:09:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14823  13 59305 40197901 A  ERRORERROR'
2021-04-01 11:09:58 [DEBUG   ] Got command RPT from MCS: ref #14825
2021-04-01 11:09:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14825  77 59305 40198105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:09:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:09:58 [DEBUG   ] Got command RPT from MCS: ref #14828
2021-04-01 11:09:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14828  12 59305 40198309 A  ERRORB¡ff'
2021-04-01 11:10:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:10:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:10:16 [DEBUG   ] Finished updating board flags in 1.135 seconds
2021-04-01 11:10:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:10:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:10:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:11:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 11:11:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:11:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:11:16 [DEBUG   ] Finished updating board flags in 1.016 seconds
2021-04-01 11:11:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:11:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:11:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:12:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:12:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:12:16 [DEBUG   ] Finished updating board flags in 1.005 seconds
2021-04-01 11:12:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:12:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:12:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:13:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:13:16 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:13:16 [DEBUG   ] Finished updating board flags in 0.961 seconds
2021-04-01 11:13:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:13:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:13:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:14:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:14:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 11:14:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:14:18 [DEBUG   ] Finished updating board flags in 2.536 seconds
2021-04-01 11:14:20 [DEBUG   ] Got command RPT from MCS: ref #14840
2021-04-01 11:14:20 [DEBUG   ] summary = ERROR
2021-04-01 11:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14840  13 59305 40460533 A  ERRORERROR'
2021-04-01 11:14:20 [DEBUG   ] Got command RPT from MCS: ref #14841
2021-04-01 11:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14841  77 59305 40460533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:14:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:14:57 [DEBUG   ] Got command RPT from MCS: ref #14857
2021-04-01 11:14:57 [DEBUG   ] summary = ERROR
2021-04-01 11:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14857  13 59305 40497581 A  ERRORERROR'
2021-04-01 11:14:57 [DEBUG   ] Got command RPT from MCS: ref #14858
2021-04-01 11:14:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14858  77 59305 40497773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:14:57 [DEBUG   ] Got command RPT from MCS: ref #14859
2021-04-01 11:14:57 [DEBUG   ] summary = ERROR
2021-04-01 11:14:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14859  13 59305 40497977 A  ERRORERROR'
2021-04-01 11:14:58 [DEBUG   ] Got command RPT from MCS: ref #14860
2021-04-01 11:14:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14860  77 59305 40498181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:14:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:14:58 [DEBUG   ] Got command RPT from MCS: ref #14861
2021-04-01 11:14:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14861  12 59305 40498385 A  ERRORB›™š'
2021-04-01 11:15:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:15:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2021-04-01 11:15:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:15:18 [DEBUG   ] Finished updating board flags in 2.409 seconds
2021-04-01 11:15:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 11:15:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 11:16:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:16:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:16:17 [DEBUG   ] Finished updating board flags in 1.275 seconds
2021-04-01 11:16:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 11:16:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 11:16:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 11:17:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:17:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 11:17:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:17:18 [DEBUG   ] Finished updating board flags in 2.101 seconds
2021-04-01 11:17:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 11:17:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 11:18:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:18:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:18:17 [DEBUG   ] Finished updating board flags in 1.069 seconds
2021-04-01 11:18:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 11:18:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 11:18:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 11:19:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:19:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:19:17 [DEBUG   ] Finished updating board flags in 1.044 seconds
2021-04-01 11:19:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 11:19:20 [DEBUG   ] Got command RPT from MCS: ref #14874
2021-04-01 11:19:20 [DEBUG   ] summary = ERROR
2021-04-01 11:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14874  13 59305 40760529 A  ERRORERROR'
2021-04-01 11:19:20 [DEBUG   ] Got command RPT from MCS: ref #14875
2021-04-01 11:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14875  77 59305 40760529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:19:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 11:19:57 [DEBUG   ] Got command RPT from MCS: ref #14893
2021-04-01 11:19:57 [DEBUG   ] summary = ERROR
2021-04-01 11:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14893  13 59305 40797657 A  ERRORERROR'
2021-04-01 11:19:57 [DEBUG   ] Got command RPT from MCS: ref #14894
2021-04-01 11:19:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14894  77 59305 40797859 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:19:58 [DEBUG   ] Got command RPT from MCS: ref #14895
2021-04-01 11:19:58 [DEBUG   ] summary = ERROR
2021-04-01 11:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14895  13 59305 40798049 A  ERRORERROR'
2021-04-01 11:19:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 11:19:58 [DEBUG   ] Got command RPT from MCS: ref #14896
2021-04-01 11:19:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14896  77 59305 40798253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:19:58 [DEBUG   ] Got command RPT from MCS: ref #14898
2021-04-01 11:19:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14898  12 59305 40798457 A  ERRORB™™š'
2021-04-01 11:20:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:20:18 [DEBUG   ] Finished updating ant stats in 0.831 seconds
2021-04-01 11:20:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:20:18 [DEBUG   ] Finished updating board flags in 2.018 seconds
2021-04-01 11:20:38 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2021-04-01 11:20:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:21:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:21:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2021-04-01 11:21:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:21:18 [DEBUG   ] Finished updating board flags in 1.905 seconds
2021-04-01 11:21:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2021-04-01 11:21:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:22:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:22:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:22:17 [DEBUG   ] Finished updating board flags in 1.371 seconds
2021-04-01 11:22:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 11:22:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:22:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:23:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:23:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:23:17 [DEBUG   ] Finished updating board flags in 1.106 seconds
2021-04-01 11:23:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:23:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:23:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:24:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:24:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:24:17 [DEBUG   ] Finished updating board flags in 1.034 seconds
2021-04-01 11:24:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:24:20 [DEBUG   ] Got command RPT from MCS: ref #14909
2021-04-01 11:24:20 [DEBUG   ] summary = ERROR
2021-04-01 11:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14909  13 59305 41060529 A  ERRORERROR'
2021-04-01 11:24:20 [DEBUG   ] Got command RPT from MCS: ref #14910
2021-04-01 11:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14910  77 59305 41060529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:24:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:24:57 [DEBUG   ] Got command RPT from MCS: ref #14927
2021-04-01 11:24:57 [DEBUG   ] summary = ERROR
2021-04-01 11:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14927  13 59305 41097729 A  ERRORERROR'
2021-04-01 11:24:57 [DEBUG   ] Got command RPT from MCS: ref #14929
2021-04-01 11:24:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:24:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14929  77 59305 41097921 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:24:58 [DEBUG   ] Got command RPT from MCS: ref #14931
2021-04-01 11:24:58 [DEBUG   ] summary = ERROR
2021-04-01 11:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14931  13 59305 41098125 A  ERRORERROR'
2021-04-01 11:24:58 [DEBUG   ] Got command RPT from MCS: ref #14933
2021-04-01 11:24:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14933  77 59305 41098321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:24:58 [DEBUG   ] Got command RPT from MCS: ref #14935
2021-04-01 11:24:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14935  12 59305 41098525 A  ERRORB˜™š'
2021-04-01 11:24:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:25:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:25:17 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:25:17 [DEBUG   ] Finished updating board flags in 0.992 seconds
2021-04-01 11:25:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:25:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:25:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:26:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:26:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:26:18 [DEBUG   ] Finished updating board flags in 1.402 seconds
2021-04-01 11:26:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:26:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:26:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:27:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:27:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:27:18 [DEBUG   ] Finished updating board flags in 1.372 seconds
2021-04-01 11:27:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 11:27:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:27:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:28:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:28:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2021-04-01 11:28:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:28:19 [DEBUG   ] Finished updating board flags in 2.145 seconds
2021-04-01 11:28:39 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2021-04-01 11:28:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 11:29:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:29:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:29:18 [DEBUG   ] Finished updating board flags in 1.049 seconds
2021-04-01 11:29:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 11:29:20 [DEBUG   ] Got command RPT from MCS: ref #14943
2021-04-01 11:29:20 [DEBUG   ] summary = ERROR
2021-04-01 11:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14943  13 59305 41360537 A  ERRORERROR'
2021-04-01 11:29:20 [DEBUG   ] Got command RPT from MCS: ref #14944
2021-04-01 11:29:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:29:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14944  77 59305 41360537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:29:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:29:57 [DEBUG   ] Got command RPT from MCS: ref #14962
2021-04-01 11:29:57 [DEBUG   ] summary = ERROR
2021-04-01 11:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14962  13 59305 41397805 A  ERRORERROR'
2021-04-01 11:29:57 [DEBUG   ] Got command RPT from MCS: ref #14963
2021-04-01 11:29:57 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:29:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14963  77 59305 41397997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:29:58 [DEBUG   ] Got command RPT from MCS: ref #14964
2021-04-01 11:29:58 [DEBUG   ] summary = ERROR
2021-04-01 11:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14964  13 59305 41398201 A  ERRORERROR'
2021-04-01 11:29:58 [DEBUG   ] Got command RPT from MCS: ref #14965
2021-04-01 11:29:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14965  77 59305 41398405 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:29:58 [DEBUG   ] Got command RPT from MCS: ref #14967
2021-04-01 11:29:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14967  12 59305 41398597 A  ERRORBš™š'
2021-04-01 11:29:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:30:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2021-04-01 11:30:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:30:19 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2021-04-01 11:30:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:30:19 [DEBUG   ] Finished updating board flags in 2.048 seconds
2021-04-01 11:30:39 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2021-04-01 11:30:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:31:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:31:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:31:18 [DEBUG   ] Finished updating board flags in 1.426 seconds
2021-04-01 11:31:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 11:31:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:31:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:32:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:32:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:32:18 [DEBUG   ] Finished updating board flags in 1.435 seconds
2021-04-01 11:32:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:32:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 11:32:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:33:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:33:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:33:18 [DEBUG   ] Finished updating board flags in 1.316 seconds
2021-04-01 11:33:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 11:33:39 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:33:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:34:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:34:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:34:18 [DEBUG   ] Finished updating board flags in 1.251 seconds
2021-04-01 11:34:19 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2021-04-01 11:34:20 [DEBUG   ] Got command RPT from MCS: ref #14984
2021-04-01 11:34:20 [DEBUG   ] summary = ERROR
2021-04-01 11:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14984  13 59305 41660541 A  ERRORERROR'
2021-04-01 11:34:20 [DEBUG   ] Got command RPT from MCS: ref #14985
2021-04-01 11:34:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14985  77 59305 41660541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:34:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:34:57 [DEBUG   ] Got command RPT from MCS: ref #15001
2021-04-01 11:34:57 [DEBUG   ] summary = ERROR
2021-04-01 11:34:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15001  13 59305 41697873 A  ERRORERROR'
2021-04-01 11:34:58 [DEBUG   ] Got command RPT from MCS: ref #15002
2021-04-01 11:34:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15002  77 59305 41698077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:34:58 [DEBUG   ] Got command RPT from MCS: ref #15003
2021-04-01 11:34:58 [DEBUG   ] summary = ERROR
2021-04-01 11:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15003  13 59305 41698269 A  ERRORERROR'
2021-04-01 11:34:58 [DEBUG   ] Got command RPT from MCS: ref #15004
2021-04-01 11:34:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15004  77 59305 41698473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:34:58 [DEBUG   ] Got command RPT from MCS: ref #15005
2021-04-01 11:34:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:34:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15005  12 59305 41698677 A  ERRORBš™š'
2021-04-01 11:35:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:35:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:35:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:35:18 [DEBUG   ] Finished updating board flags in 1.156 seconds
2021-04-01 11:35:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 11:35:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:36:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:36:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:36:18 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:36:18 [DEBUG   ] Finished updating board flags in 1.028 seconds
2021-04-01 11:36:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:36:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 11:37:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:37:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:37:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:37:19 [DEBUG   ] Finished updating board flags in 1.579 seconds
2021-04-01 11:37:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 11:37:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:38:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:38:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:38:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:38:19 [DEBUG   ] Finished updating board flags in 1.435 seconds
2021-04-01 11:38:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:38:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 11:39:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:39:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:39:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:39:19 [DEBUG   ] Finished updating board flags in 1.344 seconds
2021-04-01 11:39:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 11:39:20 [DEBUG   ] Got command RPT from MCS: ref #15012
2021-04-01 11:39:20 [DEBUG   ] summary = ERROR
2021-04-01 11:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15012  13 59305 41960537 A  ERRORERROR'
2021-04-01 11:39:20 [DEBUG   ] Got command RPT from MCS: ref #15013
2021-04-01 11:39:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:39:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15013  77 59305 41960537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:39:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 11:39:57 [DEBUG   ] Got command RPT from MCS: ref #15032
2021-04-01 11:39:57 [DEBUG   ] summary = ERROR
2021-04-01 11:39:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15032  13 59305 41997945 A  ERRORERROR'
2021-04-01 11:39:58 [DEBUG   ] Got command RPT from MCS: ref #15034
2021-04-01 11:39:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15034  77 59305 41998149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:39:58 [DEBUG   ] Got command RPT from MCS: ref #15036
2021-04-01 11:39:58 [DEBUG   ] summary = ERROR
2021-04-01 11:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15036  13 59305 41998353 A  ERRORERROR'
2021-04-01 11:39:58 [DEBUG   ] Got command RPT from MCS: ref #15038
2021-04-01 11:39:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15038  77 59305 41998545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:39:58 [DEBUG   ] Got command RPT from MCS: ref #15041
2021-04-01 11:39:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:39:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15041  12 59305 41998749 A  ERRORB™™š'
2021-04-01 11:40:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 11:40:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:40:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:40:19 [DEBUG   ] Finished updating board flags in 1.216 seconds
2021-04-01 11:40:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:40:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 11:41:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 11:41:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:41:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:41:19 [DEBUG   ] Finished updating board flags in 1.166 seconds
2021-04-01 11:41:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:41:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:42:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 11:42:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:42:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:42:19 [DEBUG   ] Finished updating board flags in 1.025 seconds
2021-04-01 11:42:20 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 11:42:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:43:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:43:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:43:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:43:19 [DEBUG   ] Finished updating board flags in 0.987 seconds
2021-04-01 11:43:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:43:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:44:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:44:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:44:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:44:20 [DEBUG   ] Finished updating board flags in 1.844 seconds
2021-04-01 11:44:20 [DEBUG   ] Got command RPT from MCS: ref #15053
2021-04-01 11:44:20 [DEBUG   ] summary = ERROR
2021-04-01 11:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15053  13 59305 42260541 A  ERRORERROR'
2021-04-01 11:44:20 [DEBUG   ] Got command RPT from MCS: ref #15054
2021-04-01 11:44:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15054  77 59305 42260541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:44:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:44:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:44:58 [DEBUG   ] Got command RPT from MCS: ref #15070
2021-04-01 11:44:58 [DEBUG   ] summary = ERROR
2021-04-01 11:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15070  13 59305 42298017 A  ERRORERROR'
2021-04-01 11:44:58 [DEBUG   ] Got command RPT from MCS: ref #15071
2021-04-01 11:44:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15071  77 59305 42298221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:44:58 [DEBUG   ] Got command RPT from MCS: ref #15072
2021-04-01 11:44:58 [DEBUG   ] summary = ERROR
2021-04-01 11:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15072  13 59305 42298425 A  ERRORERROR'
2021-04-01 11:44:58 [DEBUG   ] Got command RPT from MCS: ref #15073
2021-04-01 11:44:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15073  77 59305 42298617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:44:58 [DEBUG   ] Got command RPT from MCS: ref #15074
2021-04-01 11:44:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:44:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15074  12 59305 42298821 A  ERRORBš™š'
2021-04-01 11:45:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:45:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:45:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 11:45:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:45:20 [DEBUG   ] Finished updating board flags in 1.861 seconds
2021-04-01 11:45:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:45:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:46:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:46:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:46:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:46:19 [DEBUG   ] Finished updating board flags in 1.145 seconds
2021-04-01 11:46:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:46:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:47:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:47:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:47:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:47:19 [DEBUG   ] Finished updating board flags in 1.027 seconds
2021-04-01 11:47:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:47:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:48:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:48:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:48:19 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:48:19 [DEBUG   ] Finished updating board flags in 0.982 seconds
2021-04-01 11:48:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:48:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:49:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:49:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:49:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:49:20 [DEBUG   ] Finished updating board flags in 1.399 seconds
2021-04-01 11:49:20 [DEBUG   ] Got command RPT from MCS: ref #15087
2021-04-01 11:49:20 [DEBUG   ] summary = ERROR
2021-04-01 11:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15087  13 59305 42560541 A  ERRORERROR'
2021-04-01 11:49:20 [DEBUG   ] Got command RPT from MCS: ref #15088
2021-04-01 11:49:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:49:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15088  77 59305 42560541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:49:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:49:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:49:58 [DEBUG   ] Got command RPT from MCS: ref #15106
2021-04-01 11:49:58 [DEBUG   ] summary = ERROR
2021-04-01 11:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15106  13 59305 42598093 A  ERRORERROR'
2021-04-01 11:49:58 [DEBUG   ] Got command RPT from MCS: ref #15107
2021-04-01 11:49:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15107  77 59305 42598285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:49:58 [DEBUG   ] Got command RPT from MCS: ref #15108
2021-04-01 11:49:58 [DEBUG   ] summary = ERROR
2021-04-01 11:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15108  13 59305 42598489 A  ERRORERROR'
2021-04-01 11:49:58 [DEBUG   ] Got command RPT from MCS: ref #15109
2021-04-01 11:49:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15109  77 59305 42598693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:49:58 [DEBUG   ] Got command RPT from MCS: ref #15111
2021-04-01 11:49:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:49:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15111  12 59305 42598885 A  ERRORB›™š'
2021-04-01 11:50:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:50:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:50:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:50:20 [DEBUG   ] Finished updating board flags in 1.249 seconds
2021-04-01 11:50:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:50:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:51:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:51:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:51:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 11:51:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:51:21 [DEBUG   ] Finished updating board flags in 2.334 seconds
2021-04-01 11:51:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 11:52:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:52:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:52:21 [DEBUG   ] Finished updating ant stats in 1.030 seconds
2021-04-01 11:52:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2021-04-01 11:52:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:52:21 [DEBUG   ] Finished updating board flags in 2.034 seconds
2021-04-01 11:52:41 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2021-04-01 11:53:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 11:53:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:53:21 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2021-04-01 11:53:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:53:21 [DEBUG   ] Finished updating board flags in 2.022 seconds
2021-04-01 11:53:26 [DEBUG   ] Got command DRX from MCS: ref #15127
2021-04-01 11:53:26 [INFO    ] sending drx command to lwa16
2021-04-01 11:53:26 [DEBUG   ] run_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 0']
2021-04-01 11:53:26 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 11:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    15127   8 59305 42806009 A  ERROR'
2021-04-01 11:53:26 [DEBUG   ] Got command DRX from MCS: ref #15126
2021-04-01 11:53:26 [INFO    ] sending drx command to lwa34
2021-04-01 11:53:26 [DEBUG   ] run_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2021-04-01 11:53:26 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 11:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    15126   8 59305 42806013 A  ERROR'
2021-04-01 11:53:26 [DEBUG   ] Got command DRX from MCS: ref #15128
2021-04-01 11:53:26 [INFO    ] sending drx command to lwa34
2021-04-01 11:53:26 [DEBUG   ] run_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2021-04-01 11:53:26 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 11:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    15128   8 59305 42806017 A  ERROR'
2021-04-01 11:53:26 [DEBUG   ] Got command DRX from MCS: ref #15129
2021-04-01 11:53:26 [INFO    ] sending drx command to lwa16
2021-04-01 11:53:26 [DEBUG   ] run_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 0']
2021-04-01 11:53:26 [DEBUG   ] drx = exited with status True, code 0x00
2021-04-01 11:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    15129   8 59305 42806021 A  ERROR'
2021-04-01 11:53:26 [DEBUG   ] Got command BAM from MCS: ref #15131
2021-04-01 11:53:26 [INFO    ] Finished processing BAM request
2021-04-01 11:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15131   8 59305 42806025 A  ERROR'
2021-04-01 11:53:26 [DEBUG   ] Got command BAM from MCS: ref #15130
2021-04-01 11:53:26 [INFO    ] Finished processing BAM request
2021-04-01 11:53:26 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15130   8 59305 42806029 A  ERROR'
2021-04-01 11:53:26 [INFO    ] Finished starting DRX
2021-04-01 11:53:26 [INFO    ] Finished starting DRX
2021-04-01 11:53:26 [INFO    ] Finished starting DRX
2021-04-01 11:53:26 [INFO    ] Finished starting DRX
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 11:53:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 11:53:26 [DEBUG   ] spawn_process: at 2021-04-01 11:53:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 11:53:41 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2021-04-01 11:54:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 11:54:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:54:20 [DEBUG   ] Got command RPT from MCS: ref #15134
2021-04-01 11:54:20 [DEBUG   ] summary = ERROR
2021-04-01 11:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15134  13 59305 42860541 A  ERRORERROR'
2021-04-01 11:54:20 [DEBUG   ] Got command RPT from MCS: ref #15135
2021-04-01 11:54:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:54:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15135  77 59305 42860541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:54:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2021-04-01 11:54:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:54:20 [DEBUG   ] Finished updating board flags in 1.393 seconds
2021-04-01 11:54:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:54:37 [DEBUG   ] Got command BAM from MCS: ref #15152
2021-04-01 11:54:37 [INFO    ] Finished processing BAM request
2021-04-01 11:54:37 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:54:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15152   8 59305 42877025 A  ERROR'
2021-04-01 11:54:37 [DEBUG   ] Got command BAM from MCS: ref #15151
2021-04-01 11:54:37 [INFO    ] Finished processing BAM request
2021-04-01 11:54:37 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:54:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15151   8 59305 42877029 A  ERROR'
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 11:54:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 11:54:37 [DEBUG   ] spawn_process: at 2021-04-01 11:54:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 11:54:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 11:54:58 [DEBUG   ] Got command RPT from MCS: ref #15154
2021-04-01 11:54:58 [DEBUG   ] summary = ERROR
2021-04-01 11:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15154  13 59305 42898165 A  ERRORERROR'
2021-04-01 11:54:58 [DEBUG   ] Got command RPT from MCS: ref #15156
2021-04-01 11:54:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15156  77 59305 42898357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:54:58 [DEBUG   ] Got command RPT from MCS: ref #15158
2021-04-01 11:54:58 [DEBUG   ] summary = ERROR
2021-04-01 11:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15158  13 59305 42898561 A  ERRORERROR'
2021-04-01 11:54:58 [DEBUG   ] Got command RPT from MCS: ref #15160
2021-04-01 11:54:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15160  77 59305 42898765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:54:58 [DEBUG   ] Got command RPT from MCS: ref #15162
2021-04-01 11:54:58 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:54:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15162  12 59305 42898957 A  ERRORBŸff'
2021-04-01 11:55:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 11:55:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:55:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 11:55:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 11:55:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2021-04-01 11:55:21 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 11:55:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:55:21 [DEBUG   ] Finished updating board flags in 1.734 seconds
2021-04-01 11:55:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2021-04-01 11:55:48 [DEBUG   ] Got command BAM from MCS: ref #15164
2021-04-01 11:55:48 [INFO    ] Finished processing BAM request
2021-04-01 11:55:48 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15164   8 59305 42948033 A  ERROR'
2021-04-01 11:55:48 [DEBUG   ] Got command BAM from MCS: ref #15165
2021-04-01 11:55:48 [INFO    ] Finished processing BAM request
2021-04-01 11:55:48 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15165   8 59305 42948037 A  ERROR'
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 11:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 11:55:48 [DEBUG   ] spawn_process: at 2021-04-01 11:55:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 11:56:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:56:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:56:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2021-04-01 11:56:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:56:20 [DEBUG   ] Finished updating board flags in 1.041 seconds
2021-04-01 11:56:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 11:56:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 11:56:59 [DEBUG   ] Got command BAM from MCS: ref #15167
2021-04-01 11:56:59 [INFO    ] Finished processing BAM request
2021-04-01 11:56:59 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15167   8 59305 43019029 A  ERROR'
2021-04-01 11:56:59 [DEBUG   ] Got command BAM from MCS: ref #15166
2021-04-01 11:56:59 [INFO    ] Finished processing BAM request
2021-04-01 11:56:59 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15166   8 59305 43019033 A  ERROR'
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 11:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 11:56:59 [DEBUG   ] spawn_process: at 2021-04-01 11:56:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 11:57:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 11:57:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:57:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 11:57:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 11:57:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:57:20 [DEBUG   ] Finished updating board flags in 1.010 seconds
2021-04-01 11:57:21 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2021-04-01 11:57:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 11:58:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 11:58:10 [DEBUG   ] Got command BAM from MCS: ref #15174
2021-04-01 11:58:10 [INFO    ] Finished processing BAM request
2021-04-01 11:58:10 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15174   8 59305 43090025 A  ERROR'
2021-04-01 11:58:10 [DEBUG   ] Got command BAM from MCS: ref #15175
2021-04-01 11:58:10 [INFO    ] Finished processing BAM request
2021-04-01 11:58:10 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:58:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15175   8 59305 43090029 A  ERROR'
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 11:58:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 11:58:10 [DEBUG   ] spawn_process: at 2021-04-01 11:58:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 11:58:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 11:58:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:58:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 11:58:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 11:58:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 11:58:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:58:20 [DEBUG   ] Finished updating board flags in 1.007 seconds
2021-04-01 11:58:22 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2021-04-01 11:58:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:59:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 11:59:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 11:59:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 11:59:20 [DEBUG   ] Got command RPT from MCS: ref #15178
2021-04-01 11:59:20 [DEBUG   ] summary = ERROR
2021-04-01 11:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15178  13 59305 43160545 A  ERRORERROR'
2021-04-01 11:59:20 [DEBUG   ] Got command RPT from MCS: ref #15179
2021-04-01 11:59:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:59:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15179  77 59305 43160545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:59:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 11:59:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 11:59:20 [DEBUG   ] Finished updating board flags in 1.015 seconds
2021-04-01 11:59:21 [DEBUG   ] Got command BAM from MCS: ref #15177
2021-04-01 11:59:21 [INFO    ] Finished processing BAM request
2021-04-01 11:59:21 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15177   8 59305 43161033 A  ERROR'
2021-04-01 11:59:21 [DEBUG   ] Got command BAM from MCS: ref #15176
2021-04-01 11:59:21 [INFO    ] Finished processing BAM request
2021-04-01 11:59:21 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 11:59:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15176   8 59305 43161037 A  ERROR'
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 11:59:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 11:59:21 [DEBUG   ] spawn_process: at 2021-04-01 11:59:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 11:59:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:59:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 11:59:58 [DEBUG   ] Got command RPT from MCS: ref #15197
2021-04-01 11:59:58 [DEBUG   ] summary = ERROR
2021-04-01 11:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15197  13 59305 43198229 A  ERRORERROR'
2021-04-01 11:59:58 [DEBUG   ] Got command RPT from MCS: ref #15198
2021-04-01 11:59:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15198  77 59305 43198433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:59:58 [DEBUG   ] Got command RPT from MCS: ref #15199
2021-04-01 11:59:58 [DEBUG   ] summary = ERROR
2021-04-01 11:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15199  13 59305 43198637 A  ERRORERROR'
2021-04-01 11:59:58 [DEBUG   ] Got command RPT from MCS: ref #15200
2021-04-01 11:59:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 11:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15200  77 59305 43198829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 11:59:59 [DEBUG   ] Got command RPT from MCS: ref #15202
2021-04-01 11:59:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 11:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15202  12 59305 43199033 A  ERRORB£ff'
2021-04-01 12:00:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 12:00:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:00:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:00:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:00:20 [DEBUG   ] Finished updating board flags in 1.016 seconds
2021-04-01 12:00:23 [DEBUG   ] Finished updating ant stats in 2.002 seconds
2021-04-01 12:00:32 [DEBUG   ] Got command BAM from MCS: ref #15208
2021-04-01 12:00:32 [INFO    ] Finished processing BAM request
2021-04-01 12:00:32 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15208   8 59305 43232029 A  ERROR'
2021-04-01 12:00:32 [DEBUG   ] Got command BAM from MCS: ref #15207
2021-04-01 12:00:32 [INFO    ] Finished processing BAM request
2021-04-01 12:00:32 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:00:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15207   8 59305 43232033 A  ERROR'
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 12:00:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 12:00:32 [DEBUG   ] spawn_process: at 2021-04-01 12:00:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 12:00:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 12:01:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 12:01:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 12:01:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:01:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 12:01:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 12:01:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:01:20 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:01:20 [DEBUG   ] Finished updating board flags in 0.995 seconds
2021-04-01 12:01:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 12:01:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 12:01:43 [DEBUG   ] Got command BAM from MCS: ref #15215
2021-04-01 12:01:43 [INFO    ] Finished processing BAM request
2021-04-01 12:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15215   8 59305 43303025 A  ERROR'
2021-04-01 12:01:43 [DEBUG   ] Got command BAM from MCS: ref #15216
2021-04-01 12:01:43 [INFO    ] Finished processing BAM request
2021-04-01 12:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15216   8 59305 43303029 A  ERROR'
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 12:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 12:01:43 [DEBUG   ] spawn_process: at 2021-04-01 12:01:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 12:02:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 12:02:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2021-04-01 12:02:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:02:22 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:02:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2021-04-01 12:02:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:02:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 12:02:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:02:22 [DEBUG   ] Finished updating board flags in 2.296 seconds
2021-04-01 12:02:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2021-04-01 12:02:54 [DEBUG   ] Got command BAM from MCS: ref #15218
2021-04-01 12:02:54 [INFO    ] Finished processing BAM request
2021-04-01 12:02:54 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:02:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15218   8 59305 43374025 A  ERROR'
2021-04-01 12:02:54 [DEBUG   ] Got command BAM from MCS: ref #15217
2021-04-01 12:02:54 [INFO    ] Finished processing BAM request
2021-04-01 12:02:54 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:02:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15217   8 59305 43374029 A  ERROR'
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 12:02:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 12:02:54 [DEBUG   ] spawn_process: at 2021-04-01 12:02:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 12:03:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 12:03:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 12:03:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:03:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 12:03:21 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:03:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:03:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:03:22 [DEBUG   ] Finished updating board flags in 2.045 seconds
2021-04-01 12:03:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2021-04-01 12:03:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2021-04-01 12:04:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:04:05 [DEBUG   ] Got command BAM from MCS: ref #15225
2021-04-01 12:04:05 [INFO    ] Finished processing BAM request
2021-04-01 12:04:05 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15225   8 59305 43445029 A  ERROR'
2021-04-01 12:04:05 [DEBUG   ] Got command BAM from MCS: ref #15226
2021-04-01 12:04:05 [INFO    ] Finished processing BAM request
2021-04-01 12:04:05 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:04:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15226   8 59305 43445033 A  ERROR'
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 12:04:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 12:04:05 [DEBUG   ] spawn_process: at 2021-04-01 12:04:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 12:04:20 [DEBUG   ] Got command RPT from MCS: ref #15227
2021-04-01 12:04:20 [DEBUG   ] summary = ERROR
2021-04-01 12:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15227  13 59305 43460549 A  ERRORERROR'
2021-04-01 12:04:20 [DEBUG   ] Got command RPT from MCS: ref #15228
2021-04-01 12:04:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15228  77 59305 43460550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:04:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:04:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 12:04:21 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:04:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:04:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 12:04:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:04:21 [DEBUG   ] Finished updating board flags in 1.185 seconds
2021-04-01 12:04:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:04:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 12:04:58 [DEBUG   ] Got command RPT from MCS: ref #15244
2021-04-01 12:04:58 [DEBUG   ] summary = ERROR
2021-04-01 12:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15244  13 59305 43498301 A  ERRORERROR'
2021-04-01 12:04:58 [DEBUG   ] Got command RPT from MCS: ref #15245
2021-04-01 12:04:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15245  77 59305 43498505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:04:58 [DEBUG   ] Got command RPT from MCS: ref #15246
2021-04-01 12:04:58 [DEBUG   ] summary = ERROR
2021-04-01 12:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15246  13 59305 43498709 A  ERRORERROR'
2021-04-01 12:04:58 [DEBUG   ] Got command RPT from MCS: ref #15247
2021-04-01 12:04:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15247  77 59305 43498901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:04:59 [DEBUG   ] Got command RPT from MCS: ref #15248
2021-04-01 12:04:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 12:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15248  12 59305 43499105 A  ERRORB¤ff'
2021-04-01 12:05:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 12:05:16 [DEBUG   ] Got command BAM from MCS: ref #15249
2021-04-01 12:05:16 [INFO    ] Finished processing BAM request
2021-04-01 12:05:16 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15249   8 59305 43516029 A  ERROR'
2021-04-01 12:05:16 [DEBUG   ] Got command BAM from MCS: ref #15250
2021-04-01 12:05:16 [INFO    ] Finished processing BAM request
2021-04-01 12:05:16 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:05:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15250   8 59305 43516033 A  ERROR'
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 12:05:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 12:05:16 [DEBUG   ] spawn_process: at 2021-04-01 12:05:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 12:05:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 12:05:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:05:21 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 12:05:21 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:05:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 12:05:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:05:21 [DEBUG   ] Finished updating board flags in 1.007 seconds
2021-04-01 12:05:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:05:43 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2021-04-01 12:06:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:06:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:06:21 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:06:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:06:21 [DEBUG   ] Finished updating board flags in 1.015 seconds
2021-04-01 12:06:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:06:27 [DEBUG   ] Got command BAM from MCS: ref #15252
2021-04-01 12:06:27 [INFO    ] Finished processing BAM request
2021-04-01 12:06:27 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15252   8 59305 43587029 A  ERROR'
2021-04-01 12:06:27 [DEBUG   ] Got command BAM from MCS: ref #15251
2021-04-01 12:06:27 [INFO    ] Finished processing BAM request
2021-04-01 12:06:27 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:06:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15251   8 59305 43587033 A  ERROR'
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 12:06:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 12:06:27 [DEBUG   ] spawn_process: at 2021-04-01 12:06:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 12:06:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:07:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:07:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 12:07:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:07:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 12:07:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:07:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:07:21 [DEBUG   ] Finished updating board flags in 0.990 seconds
2021-04-01 12:07:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:07:38 [DEBUG   ] Got command BAM from MCS: ref #15259
2021-04-01 12:07:38 [INFO    ] Finished processing BAM request
2021-04-01 12:07:38 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15259   8 59305 43658029 A  ERROR'
2021-04-01 12:07:38 [DEBUG   ] Got command BAM from MCS: ref #15260
2021-04-01 12:07:38 [INFO    ] Finished processing BAM request
2021-04-01 12:07:38 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:07:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15260   8 59305 43658033 A  ERROR'
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 12:07:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 12:07:38 [DEBUG   ] spawn_process: at 2021-04-01 12:07:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 12:07:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 12:08:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 12:08:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:08:22 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2021-04-01 12:08:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 12:08:22 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 12:08:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:08:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 12:08:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:08:22 [DEBUG   ] Finished updating board flags in 1.871 seconds
2021-04-01 12:08:42 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2021-04-01 12:08:49 [DEBUG   ] Got command BAM from MCS: ref #15262
2021-04-01 12:08:49 [INFO    ] Finished processing BAM request
2021-04-01 12:08:49 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15262   8 59305 43729025 A  ERROR'
2021-04-01 12:08:49 [DEBUG   ] Got command BAM from MCS: ref #15261
2021-04-01 12:08:49 [INFO    ] Finished processing BAM request
2021-04-01 12:08:49 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15261   8 59305 43729029 A  ERROR'
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 12:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 12:08:49 [DEBUG   ] spawn_process: at 2021-04-01 12:08:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 12:09:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 12:09:20 [DEBUG   ] Got command RPT from MCS: ref #15263
2021-04-01 12:09:20 [DEBUG   ] summary = ERROR
2021-04-01 12:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15263  13 59305 43760541 A  ERRORERROR'
2021-04-01 12:09:20 [DEBUG   ] Got command RPT from MCS: ref #15264
2021-04-01 12:09:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:09:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15264  77 59305 43760541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:09:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 12:09:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2021-04-01 12:09:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:09:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 12:09:21 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:09:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:09:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:09:21 [DEBUG   ] Finished updating board flags in 1.249 seconds
2021-04-01 12:09:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 12:09:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 12:09:58 [DEBUG   ] Got command RPT from MCS: ref #15283
2021-04-01 12:09:58 [DEBUG   ] summary = ERROR
2021-04-01 12:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15283  13 59305 43798377 A  ERRORERROR'
2021-04-01 12:09:58 [DEBUG   ] Got command RPT from MCS: ref #15285
2021-04-01 12:09:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15285  77 59305 43798581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:09:58 [DEBUG   ] Got command RPT from MCS: ref #15287
2021-04-01 12:09:58 [DEBUG   ] summary = ERROR
2021-04-01 12:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15287  13 59305 43798773 A  ERRORERROR'
2021-04-01 12:09:58 [DEBUG   ] Got command RPT from MCS: ref #15289
2021-04-01 12:09:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:09:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15289  77 59305 43798977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:09:59 [DEBUG   ] Got command RPT from MCS: ref #15294
2021-04-01 12:09:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 12:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15294  12 59305 43799181 A  ERRORB¤ff'
2021-04-01 12:10:00 [DEBUG   ] Got command BAM from MCS: ref #15290
2021-04-01 12:10:00 [INFO    ] Finished processing BAM request
2021-04-01 12:10:00 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15290   8 59305 43800025 A  ERROR'
2021-04-01 12:10:00 [DEBUG   ] Got command BAM from MCS: ref #15291
2021-04-01 12:10:00 [INFO    ] Finished processing BAM request
2021-04-01 12:10:00 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:10:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15291   8 59305 43800029 A  ERROR'
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 12:10:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 12:10:00 [DEBUG   ] spawn_process: at 2021-04-01 12:10:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 12:10:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 12:10:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:10:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 12:10:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 12:10:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 12:10:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:10:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:10:21 [DEBUG   ] Finished updating board flags in 1.140 seconds
2021-04-01 12:10:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 12:10:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 12:11:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 12:11:11 [DEBUG   ] Got command BAM from MCS: ref #15301
2021-04-01 12:11:11 [INFO    ] Finished processing BAM request
2021-04-01 12:11:11 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15301   8 59305 43871033 A  ERROR'
2021-04-01 12:11:11 [DEBUG   ] Got command BAM from MCS: ref #15300
2021-04-01 12:11:11 [INFO    ] Finished processing BAM request
2021-04-01 12:11:11 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:11:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15300   8 59305 43871037 A  ERROR'
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 12:11:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 12:11:11 [DEBUG   ] spawn_process: at 2021-04-01 12:11:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 12:11:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 12:11:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:11:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2021-04-01 12:11:21 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 12:11:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:11:21 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:11:21 [DEBUG   ] Finished updating board flags in 0.976 seconds
2021-04-01 12:11:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 12:11:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 12:12:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2021-04-01 12:12:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 12:12:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:12:22 [DEBUG   ] Got command BAM from MCS: ref #15302
2021-04-01 12:12:22 [INFO    ] Finished processing BAM request
2021-04-01 12:12:22 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15302   8 59305 43942037 A  ERROR'
2021-04-01 12:12:22 [DEBUG   ] Got command BAM from MCS: ref #15303
2021-04-01 12:12:22 [INFO    ] Finished processing BAM request
2021-04-01 12:12:22 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:12:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15303   8 59305 43942045 A  ERROR'
2021-04-01 12:12:22 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2021-04-01 12:12:22 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:12:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:12:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 12:12:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:12:22 [DEBUG   ] Finished updating board flags in 1.437 seconds
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 12:12:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 12:12:22 [DEBUG   ] spawn_process: at 2021-04-01 12:12:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 12:12:42 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2021-04-01 12:13:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2021-04-01 12:13:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 12:13:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:13:23 [DEBUG   ] Finished updating ant stats in 1.230 seconds
2021-04-01 12:13:23 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:13:23 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:13:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 12:13:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:13:23 [DEBUG   ] Finished updating board flags in 2.401 seconds
2021-04-01 12:13:33 [DEBUG   ] Got command BAM from MCS: ref #15310
2021-04-01 12:13:33 [INFO    ] Finished processing BAM request
2021-04-01 12:13:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15310   8 59305 44013029 A  ERROR'
2021-04-01 12:13:33 [DEBUG   ] Got command BAM from MCS: ref #15311
2021-04-01 12:13:33 [INFO    ] Finished processing BAM request
2021-04-01 12:13:33 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15311   8 59305 44013033 A  ERROR'
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 12:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 12:13:33 [DEBUG   ] spawn_process: at 2021-04-01 12:13:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 12:13:43 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2021-04-01 12:14:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 12:14:20 [DEBUG   ] Got command RPT from MCS: ref #15312
2021-04-01 12:14:20 [DEBUG   ] summary = ERROR
2021-04-01 12:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15312  13 59305 44060549 A  ERRORERROR'
2021-04-01 12:14:20 [DEBUG   ] Got command RPT from MCS: ref #15313
2021-04-01 12:14:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:14:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15313  77 59305 44060549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:14:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2021-04-01 12:14:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:14:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 12:14:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2021-04-01 12:14:22 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:14:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:14:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:14:22 [DEBUG   ] Finished updating board flags in 1.350 seconds
2021-04-01 12:14:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 12:14:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 12:14:44 [DEBUG   ] Got command BAM from MCS: ref #15330
2021-04-01 12:14:44 [INFO    ] Finished processing BAM request
2021-04-01 12:14:44 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15330   8 59305 44084025 A  ERROR'
2021-04-01 12:14:44 [DEBUG   ] Got command BAM from MCS: ref #15329
2021-04-01 12:14:44 [INFO    ] Finished processing BAM request
2021-04-01 12:14:44 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:14:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15329   8 59305 44084029 A  ERROR'
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 12:14:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 12:14:44 [DEBUG   ] spawn_process: at 2021-04-01 12:14:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 12:14:58 [DEBUG   ] Got command RPT from MCS: ref #15331
2021-04-01 12:14:58 [DEBUG   ] summary = ERROR
2021-04-01 12:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15331  13 59305 44098453 A  ERRORERROR'
2021-04-01 12:14:58 [DEBUG   ] Got command RPT from MCS: ref #15332
2021-04-01 12:14:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15332  77 59305 44098645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:14:58 [DEBUG   ] Got command RPT from MCS: ref #15333
2021-04-01 12:14:58 [DEBUG   ] summary = ERROR
2021-04-01 12:14:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15333  13 59305 44098849 A  ERRORERROR'
2021-04-01 12:14:59 [DEBUG   ] Got command RPT from MCS: ref #15334
2021-04-01 12:14:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15334  77 59305 44099053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:14:59 [DEBUG   ] Got command RPT from MCS: ref #15335
2021-04-01 12:14:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 12:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15335  12 59305 44099257 A  ERRORB¤ff'
2021-04-01 12:15:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 12:15:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 12:15:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:15:22 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:15:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:15:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 12:15:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:15:22 [DEBUG   ] Finished updating board flags in 1.253 seconds
2021-04-01 12:15:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2021-04-01 12:15:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 12:15:55 [DEBUG   ] Got command BAM from MCS: ref #15336
2021-04-01 12:15:55 [INFO    ] Finished processing BAM request
2021-04-01 12:15:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:15:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15336   8 59305 44155033 A  ERROR'
2021-04-01 12:15:55 [DEBUG   ] Got command BAM from MCS: ref #15337
2021-04-01 12:15:55 [INFO    ] Finished processing BAM request
2021-04-01 12:15:55 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:15:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15337   8 59305 44155037 A  ERROR'
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 12:15:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 12:15:55 [DEBUG   ] spawn_process: at 2021-04-01 12:15:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 12:16:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2021-04-01 12:16:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:16:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2021-04-01 12:16:23 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:16:23 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:16:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:16:23 [DEBUG   ] Finished updating board flags in 2.140 seconds
2021-04-01 12:16:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2021-04-01 12:17:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 12:17:06 [DEBUG   ] Got command BAM from MCS: ref #15344
2021-04-01 12:17:06 [INFO    ] Finished processing BAM request
2021-04-01 12:17:06 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:17:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15344   8 59305 44226025 A  ERROR'
2021-04-01 12:17:06 [DEBUG   ] Got command BAM from MCS: ref #15345
2021-04-01 12:17:06 [INFO    ] Finished processing BAM request
2021-04-01 12:17:06 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:17:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15345   8 59305 44226029 A  ERROR'
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 12:17:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 12:17:06 [DEBUG   ] spawn_process: at 2021-04-01 12:17:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 12:17:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:17:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 12:17:22 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:17:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:17:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 12:17:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:17:22 [DEBUG   ] Finished updating board flags in 0.989 seconds
2021-04-01 12:17:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2021-04-01 12:17:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 12:18:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2021-04-01 12:18:17 [DEBUG   ] Got command BAM from MCS: ref #15347
2021-04-01 12:18:17 [INFO    ] Finished processing BAM request
2021-04-01 12:18:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15347   8 59305 44297025 A  ERROR'
2021-04-01 12:18:17 [DEBUG   ] Got command BAM from MCS: ref #15346
2021-04-01 12:18:17 [INFO    ] Finished processing BAM request
2021-04-01 12:18:17 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15346   8 59305 44297029 A  ERROR'
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 12:18:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 12:18:17 [DEBUG   ] spawn_process: at 2021-04-01 12:18:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 12:18:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2021-04-01 12:18:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:18:23 [DEBUG   ] Finished updating ant stats in 0.834 seconds
2021-04-01 12:18:23 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 12:18:23 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:18:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:18:23 [DEBUG   ] Finished updating board flags in 1.914 seconds
2021-04-01 12:18:43 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2021-04-01 12:19:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 12:19:20 [DEBUG   ] Got command RPT from MCS: ref #15354
2021-04-01 12:19:20 [DEBUG   ] summary = ERROR
2021-04-01 12:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15354  13 59305 44360545 A  ERRORERROR'
2021-04-01 12:19:20 [DEBUG   ] Got command RPT from MCS: ref #15355
2021-04-01 12:19:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:19:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15355  77 59305 44360545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:19:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2021-04-01 12:19:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:19:22 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 12:19:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:19:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2021-04-01 12:19:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:19:22 [DEBUG   ] Finished updating board flags in 1.175 seconds
2021-04-01 12:19:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 12:19:28 [DEBUG   ] Got command BAM from MCS: ref #15372
2021-04-01 12:19:28 [INFO    ] Finished processing BAM request
2021-04-01 12:19:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:19:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15372   8 59305 44368033 A  ERROR'
2021-04-01 12:19:28 [DEBUG   ] Got command BAM from MCS: ref #15371
2021-04-01 12:19:28 [INFO    ] Finished processing BAM request
2021-04-01 12:19:28 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:19:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15371   8 59305 44368037 A  ERROR'
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2021-04-01 12:19:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2021-04-01 12:19:28 [DEBUG   ] spawn_process: at 2021-04-01 12:19:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2021-04-01 12:19:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 12:19:58 [DEBUG   ] Got command RPT from MCS: ref #15375
2021-04-01 12:19:58 [DEBUG   ] summary = ERROR
2021-04-01 12:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15375  13 59305 44398525 A  ERRORERROR'
2021-04-01 12:19:58 [DEBUG   ] Got command RPT from MCS: ref #15376
2021-04-01 12:19:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15376  77 59305 44398717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:19:58 [DEBUG   ] Got command RPT from MCS: ref #15377
2021-04-01 12:19:58 [DEBUG   ] summary = ERROR
2021-04-01 12:19:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15377  13 59305 44398921 A  ERRORERROR'
2021-04-01 12:19:59 [DEBUG   ] Got command RPT from MCS: ref #15378
2021-04-01 12:19:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15378  77 59305 44399129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:19:59 [DEBUG   ] Got command RPT from MCS: ref #15380
2021-04-01 12:19:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 12:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15380  12 59305 44399321 A  ERRORB£ff'
2021-04-01 12:20:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:20:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 12:20:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:20:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 12:20:22 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:20:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:20:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:20:22 [DEBUG   ] Finished updating board flags in 1.045 seconds
2021-04-01 12:20:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:20:39 [DEBUG   ] Got command BAM from MCS: ref #15386
2021-04-01 12:20:39 [INFO    ] Finished processing BAM request
2021-04-01 12:20:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15386   8 59305 44439025 A  ERROR'
2021-04-01 12:20:39 [DEBUG   ] Got command BAM from MCS: ref #15385
2021-04-01 12:20:39 [INFO    ] Finished processing BAM request
2021-04-01 12:20:39 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15385   8 59305 44439029 A  ERROR'
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2021-04-01 12:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2021-04-01 12:20:39 [DEBUG   ] spawn_process: at 2021-04-01 12:20:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2021-04-01 12:20:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:21:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 12:21:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:21:22 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:21:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:21:22 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:21:22 [DEBUG   ] Finished updating board flags in 0.961 seconds
2021-04-01 12:21:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:21:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2021-04-01 12:21:50 [DEBUG   ] Got command BAM from MCS: ref #15387
2021-04-01 12:21:50 [INFO    ] Finished processing BAM request
2021-04-01 12:21:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15387   8 59305 44510029 A  ERROR'
2021-04-01 12:21:50 [DEBUG   ] Got command BAM from MCS: ref #15388
2021-04-01 12:21:50 [INFO    ] Finished processing BAM request
2021-04-01 12:21:50 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15388   8 59305 44510033 A  ERROR'
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2021-04-01 12:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2021-04-01 12:21:50 [DEBUG   ] spawn_process: at 2021-04-01 12:21:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2021-04-01 12:22:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2021-04-01 12:22:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 12:22:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:22:23 [DEBUG   ] Finished updating ant stats in 0.632 seconds
2021-04-01 12:22:23 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:22:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:22:23 [DEBUG   ] Finished updating board flags in 1.389 seconds
2021-04-01 12:22:43 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2021-04-01 12:23:01 [DEBUG   ] Got command BAM from MCS: ref #15396
2021-04-01 12:23:01 [INFO    ] Finished processing BAM request
2021-04-01 12:23:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:23:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15396   8 59305 44581029 A  ERROR'
2021-04-01 12:23:01 [DEBUG   ] Got command BAM from MCS: ref #15395
2021-04-01 12:23:01 [INFO    ] Finished processing BAM request
2021-04-01 12:23:01 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:23:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15395   8 59305 44581033 A  ERROR'
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2021-04-01 12:23:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2021-04-01 12:23:01 [DEBUG   ] spawn_process: at 2021-04-01 12:23:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2021-04-01 12:23:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2021-04-01 12:23:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:23:23 [DEBUG   ] Finished updating ant stats in 0.432 seconds
2021-04-01 12:23:23 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2021-04-01 12:23:23 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:23:23 [DEBUG   ] Finished updating board flags in 1.221 seconds
2021-04-01 12:23:43 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2021-04-01 12:24:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2021-04-01 12:24:12 [DEBUG   ] Got command BAM from MCS: ref #15398
2021-04-01 12:24:12 [INFO    ] Finished processing BAM request
2021-04-01 12:24:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15398   8 59305 44652025 A  ERROR'
2021-04-01 12:24:12 [DEBUG   ] Got command BAM from MCS: ref #15397
2021-04-01 12:24:12 [INFO    ] Finished processing BAM request
2021-04-01 12:24:12 [DEBUG   ] bam = exited with status True, code 0x00
2021-04-01 12:24:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    15397   8 59305 44652029 A  ERROR'
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2021-04-01 12:24:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2021-04-01 12:24:12 [DEBUG   ] spawn_process: at 2021-04-01 12:24:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2021-04-01 12:24:20 [DEBUG   ] Got command RPT from MCS: ref #15399
2021-04-01 12:24:20 [DEBUG   ] summary = ERROR
2021-04-01 12:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15399  13 59305 44660549 A  ERRORERROR'
2021-04-01 12:24:20 [DEBUG   ] Got command RPT from MCS: ref #15400
2021-04-01 12:24:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:24:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15400  77 59305 44660549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:24:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2021-04-01 12:24:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2021-04-01 12:24:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2021-04-01 12:24:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2021-04-01 12:24:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2021-04-01 12:24:24 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2021-04-01 12:24:24 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2021-04-01 12:24:24 [CRITICAL] MGT underflow detected on beam(s) 1
2021-04-01 12:24:24 [DEBUG   ] Finished updating board flags in 2.296 seconds
2021-04-01 12:24:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2021-04-01 12:24:58 [DEBUG   ] Got command RPT from MCS: ref #15417
2021-04-01 12:24:58 [DEBUG   ] summary = ERROR
2021-04-01 12:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15417  13 59305 44698593 A  ERRORERROR'
2021-04-01 12:24:58 [DEBUG   ] Got command RPT from MCS: ref #15419
2021-04-01 12:24:58 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:24:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15419  77 59305 44698797 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:24:59 [DEBUG   ] Got command RPT from MCS: ref #15421
2021-04-01 12:24:59 [DEBUG   ] summary = ERROR
2021-04-01 12:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15421  13 59305 44699001 A  ERRORERROR'
2021-04-01 12:24:59 [DEBUG   ] Got command RPT from MCS: ref #15423
2021-04-01 12:24:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2021-04-01 12:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15423  77 59305 44699193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2021-04-01 12:24:59 [DEBUG   ] Got command RPT from MCS: ref #15425
2021-04-01 12:24:59 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2021-04-01 12:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15425  12 59305 44699397 A  ERRORB£ff'
